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Preface 


This book is intended as an elementary introduction to Sin ear algebra 
anti matrix Lheory for first year students in Universities and Polytechnics, 
It is suitable for intending mathematicians, scientists, engineer? and 
social scientists who require a thorough grounding in linear algebra 3rKl 
matrix theory as part of their course. It has been used in a class which 
included both mathematicians and scientists and is based on a Sirs * year 
course given at the University College of Wales* Aberystwyth over a 
number of years. 

Although there arc many excellent books already available on this 
subject, the author has not found one which is totally suitable for use 
at this level. They tend in general to be too long and encyclopaedic and 
the approach too abstract to be used as a course text in a first introduc¬ 
tion to the subject. The approach used m tins book emphasises the 
computational and practical aspects of the subject , but at the same time 
it aims to give a thorough and rigorous introduction to the subject at a 
level which es suitable for use as a first Introduction to abstract concepts 
in mathematics. The book is Structured SO as to first give the more 
concrete and practical aspects which lead naturally to the mote abstract 
ideas developed later. 

The bo-ok's six chapters cover linear equations and matrices, 
determinants, vector spaces, linear transformations on vector spaces, 
inner product spaces and diagonulization of matrices and linear trans¬ 
formations. The firsi two chapters, after firsi motivating the discussion 
by considering 2 - 1 and 3x3 matrices and determinants and the 
cm responding linear equations, proceed to develop these concepts for 
general m x n arrays. The main emphasis is in providing efficient and 
effective techniques for solving linear equations, expanding determi¬ 
nants, manipulating matrices, etc. Tire later chapters are more abstract 
in character, but each new abstract concept is motivated by considering 
the relevant concept In 2- or ^-dimensions. The a an is to show that she 
definitions of these abstract concepts are the natural and useful 
extensions of what occurs in lower dimensions. Furthermore, it is 
hoped that the student will develop an appreciation that abstraction 
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not only adds elegance 10 the subject but that it also loads quickly to 
effective techniques for dealing with certain practical problems. The 
exercises have also been selected to give the reader practical experience 
of the new concepts as they are introduced. They have only rarely been 
used to develop additional theory as is sometimes customary . 

A rudimentary knowledge of algebra is assumed, c.g, complex 
numbers, fields, set theory, equivalence relations and mappings, which 
should be available to the reader through a concurrent or preceding 
course {or for some from their A-level courses!, A general reference is 
l J. Higgjns-A First Course in Abstract Algebra, VNR New Mathemat¬ 
ics Library 7. 

The book has benefited from the detailed reading of my colleague 
Mr, Men rig John; l am graieful to him for bis ready assistance ai I am 
to Mrs. Moreen Davies who patiently typed the manuscript. 

The University College of Wales Alun 0. Morris 

Aberystwyth 

Match 1977 


Preface to the Second Edition 

The second edition of thi-s hook U largely a reproduction of the first 
edition. I have taken advantage of the opportunity lo clarify a few 
obscurities and to correct some minor errors in the first edition. 1 am 
indebted to my colleagues who have drawn my attention to these. 

The major changes have resulted Lit more examples of vector spaces 
and linear transformations with an analytic flavour, a complete re¬ 
writing of the effect of a change of basis on the matrix of a linear 
transformation and a fuller treatment on the application of quadratic 
forms to the classification of conic sections and quadric surfaces. At the 
suggestion of many readers, solutions for all the exercises have been 
included. 

The University College of Wales AJun 0. Morris 

Aberystwyth 

June 19JJ2 
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CHAPTER 


Linear Equations and Matrices 


L.I Introduction 


The reader iis probably already familiar with some methods for solving 
systems of linear equations where a small number of equations and 
variables are Involved. Applications of linear algebra to other branches 
of science, engineering, economics or elsewhere generally occur via the 
need to solve such Systems of linear equations. It may be claimed that 
one uf the main aimj of linear algebra is to 

(i ) find the mosi economic way of manipulating and solving such 
systems, 

(li) obtain useful theoretical results concerning such systems. 

At an elementary level., the method normally used for the solution 
of a system of linear equations is one involving either the use of 
determinants or the use of an elimination process, In this chapter, our 
intention is to develop this second method to the general case. This 
turns out to be the most efficient method of dealing with such a system. 

As motivation for the work u> be developed in the remainder of this 
chapter, We first illustrate the work by considering a few examples. 

EXAMPLE Kind ail the solutions of the following systems, of linear 
equations' 


(i) r,— 2jr±+Jfj = 1 

2jv, — Jfj + Xj — 2 
4xV+ Xj— Tj - 1 
(ill) *i-2* a + j i = 1 
2*1 “ X-t + *3 = 2 


(ii) *i + = 2 

2jti ■+ 2 jci = 3 


(i) Subtract twice and four times the first equation from the second 
and third equations respectively, .giving the system of equations 


ir l -2x 1 + X] 


-Ti 

9x2 — 


I 

0 

—3 


1 








Now. divide the second equation by 3 and add Iwice the resulting 
equation to the firs,! equation and subtract nine lines the resulting 
equation from the third equation, giving 

+ijfj = 1 

A a —ixj = 0 

-2x 3 = -3 

which leads to the solution 

*1 =~i *i = 1 *3 = 3 

this is the unique solution, of the original system of equations. What wc 
have done is to replace in a systematic way the original system of 
equations by a system of equations “"equivalent" to it whose solution is 
more easily obtained. 

(u) These two equations are inconsistent, since subtracting twice 
one equation from the oiher leads to the fallacious statement 1=0, 
thus no solution exists in this case, 

(iii) The system of equations may be reduced Lo the system of 
equations 

x i + i*5 ■ I 

= 0 

or in other words 

* i -4*3 

*3 “ i*, 

If we now put jj = f, wc find that whatever value we assign lo s. we 
obtain a solution of the original system of equations. Fur example, if 
t — 0, = t, x 3 = Jc 3 = 0 is a solution and if t — 3 a jt , = 0, - 1, 

jr 3 — 3 is another soluiion In this esse, not only does a solution exist, 
but there is more than one solution to the system. 

From the above examp its „ we note that a system may have 
(i) no solution, (ji) a unique solution, or (hi) more than one solution. 
Furthermore, the process of solution is to use a systematic method of 
elimination which leads to a '"simpler equivalent'" system of equations 
whose solution is more easily computed. 

InJtiaily. we shall be most interested in the technique of solution of 
linear equations, later we shall take up further the questions 

(i) When do solutions exist? 

(ii) When is a solution the unique solution? 


1 ,2 Elementary Row Operations on Matrices 

Let A' be a field, 

DEFINITION J .1 A rectangular array of elements of K 



is called a matrix, For i =1,2.... , ffl. lei 


ft = (.«/«> 

and for j = lot 



ih%n the r t (i = f .... m) an- called the rows of the matrix and the 

tv {j= I . n)are called the columns of ike matrix. A matrix with 

m rows and n columns fa called an m x tt mar rex. The clement ofKai 
the intersection of the ith row and fih column is called the (f r j)th 
element of the matrix. The matrix is written in abbreviated form as 


A = K>™*» m A =( tt U> 

EXAMPLE 

10-31 V 

2 1 3 3 j 

\ 1 0 11/ 


f—2 


ts y 3 k 4 matrix* where {2, 1,3 t 1) is a row of the matrix and | 3 Jis a 
column of the matrix. 


DEFINITION 1,2 The following are called elementary row operations 

on a matrix A = (^), 
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(i) if 1 ^ i<k m. &. G K, a ^ 0. multiply the ith row of A by a, 

(ii) if 1 < i, i < m. f =£ /, a € K, add a rimes the jlh row to the irk 
row, 

(iii) interchange the ith and jth rows. 

If r f {i— 1.mi are the m rows of A , these (hree elementary 

row operations Me written as follows 

<i) r t - o r iT (ii) r t ■* r t 4- ar fi (iii) t i ++r f 

DEFINITION 1*3 If A and B are two m < n matrices , then A is row 
equivalent to B if B can be obtained from A fry a finite sequence oj 
elementary row operations, 

EXAMPLE 

/ l 0 — 1 1 V 

2 1 0 1 

\-l 1 0 2 / 


is row equivalent to 

/ i o —i i\ 

-II 0 2 

\ 0 3 0 5 / 


smce 


0 -I I 


■'t + 


Q 
3 

L-I 1 



— 1 1 

0 5 

O 21 


DEFINITION 1,4 An m ' n matrix A is called an echelon matrix if 

(i) the first non-zero element in each non-zero row is i, 

(ii) the leading l in my non-zero row occurs to the right of the 
leading i in my preceding row, 

(iii) the non-two rows appear bef ore the zero rows, 

An echelon matrix is caiied a reduced echelon matrix if 

(iv) the leading I in any non-zero row is the only non-zero element 
in the column in which that / occurs 
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EXAMPLE 


( I 0 “i 2 

0 ] 13 

0 0 II 

is an echelon matrix, but not a reduced echelon matrix, 


n o o 3 
0 10 2 
\o o i i 


is a reduced echelon matrix, but 


(0 1 0 2\ 

1 0 2 0 I and 

\C 0 0 0/ 


Z 1 

0 


\o 


0 2 
0 0 
1 0 


0 

0 

? 

+- 


are nos even echelon matrices. 
IVe can now prove 


THEOREM 1.5 Every m x n matrix is row equivalent to an m x rr 
reduced echelon matrix. 


PROOF iCarns Elimination Method) Lei the/th column oI A , where 
t n r be the first column of A which contains a nun-aero element. 
Suppose that ct^ ^0. where I < r < m, then the elementary row 

operation r, - — r, followed by the elementary row opera (ion 

a if 

r l -*rr j gives a matrix with I in the {l ^-position. viz: 


An 


f ln 


ft/nn j 

Now, the elementary row operations^ -* r k Fj {k = 2.m 1 

result in the matrix 


fo 

. . , 0 

1 


0 

* 

. , , 0 


^1 ,) +1 

\o 

, . , 0 


hrt, / +1 ' ' 
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P ■■ 

. 0 

1 

Ti. /+1 

« ■ ■ T,„ \ 



0 , . 

. 0 

0 

Ti,/ + | 

. , . y ln 



I L ‘ 

\0 . . 

. 0 

0 

Tm, i -+t 

y i 

■ ’ 'mri f 


If at this stage, some zero towi have jppeared, row interchanges can be 


used sci that the non-aerp rows appear before the rows. We now- 
re peal the same process with the lass m — I rows of this matrix to form 


/o. 

.01 * l/+( . * 

®J, ft— 

1 ^ Lk 

y l, k +1 ■ 

- ' ^lfl \ 


0 . 

..000 

0 

I 

^a/jfc+i * 

■ - ^ \ 


0 , 

,,000 

0 



■ ■ 

(I 

\o . 

..000 

0 

<u 

^"1, fr+| ' 

■ ■ Lnl 



After □ finite number of steps j matrix which is in echelon form results. 
A matrix which is in reduced echelon form b obtained from this by 
carrying out a sequence of elementary row operations of the type 1.2 
(il), for example, the sequence of elementary tow- operations 
r t •* r t — & ik r 2 0 ~ 1-3. m} reduces the matrix (1 ,i to the form 


P - 

..01 

- , , e . 

, ft-l ^ *(.*^1 

0 . 

.,000 

- . . 0 


0 . 

,.000 

*, . o 

0 ^.*+1 

lo . 

,*ooo 

, , - 0 

0 



This completes the proof of the theorem. I 

The above proof will be better understood If the following example 
is worked oui in detail. 


EXAMPLE 


Let 

A 


j 0 0 5 

0 2 l 

0 J 2 

1 ° ° ° 
\0 5 3 


35 -24 i\ 

-3 I 0 I 

2 -I 1 

0 0 0 

1 0 1 / 
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Tire elementary row operations f 3 -* Jf ?i f, +*r t and f, ++ r s gives the 
matrix 

/0 1 l * 0\ 

0 0 5 35 -24 J ‘ 

0 3 2 2 ”11 

[0 5 3 3 0 1 

\o 0 0 0 0 0 / 


The elementary row operations r 3 *+ f 3 — 3 r u r+ -~u~ give the 


matrix 

1 

1 

-4 

4 

°\ 


0 

0 

5 

35 

-24 

i 


0 

0 

4 

4 

H 

3 


1 ° 

0 

* 

4 

-3 

J 


\o 

0 

0 

0 

0 

0 1 


Now, the elementary row operations r 3 w r 3 , r t -+ r L — f 3 , r 4 -* r 4 - r 3l 
Fj -"Fj — IOfj, r 2 2 fi performed in that order give the matrix 


to 

I 

0 

-4 

3 -1\ 

l 0 

0 

1 

7 

—5 2 



0 

0 

0 

0 

1 -9 


1 0 

0 

0 

0 

o 


\o 

0 

0 

0 

0 0/ 

and. finally. r, 

-Tl 


r 2 r 3 + 5r 

j now gives the reduced echelon 

matrix 





1° 

1 

0 

-4 

0 26 \ 


0 

0 

1 

7 

0 -43 1 



0 

0 

0 

0 

1 

(3) 


l 0 

0 

0 

0 

O 0 , 


\o 

0 

0 

0 

0 0/ 


Note: It is important that these elementary row operations jhouid be 
earned out in (he order stated. 
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Exercises 1.2 

L Find the reduced echelon matrices of the folio wing matrices 


(0 /I 
2 
a 


i 


2 1 
-i 1 
1 l 


Cii) 


/' ‘ 

' t —t i 


\2 1 - 1 / 


(iii) 



(iv) /0 1 

i 4 


2 

3 
l 5 


-I 

0 


(v) 

( * 

1 - i i O' 

\ 


1 

-2 0 f 



V-r 

-l + 1 I 1 

/ 

fvil 

/ 1 

S-VT 

0 


V2 

-3 

l 4- vT 


-1 

VT 

-I 


\vT-2 

-2 + 4v^" 

— 2 — VT 



2 : Are r he following pairs of matrices row equivalent 



n 

0 

3./ 


4 

5 
4 

10 
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L3 Application (o Linear Equations 

Consider the system ofm linear equations in n variables jc >p , , ,, jc JlP 


= (f= 1.rt) (4) 


where £ A, then 

^ = CVi"Xi antt (j41 ^ = 

arc called the mrrfriv o/frw/pWenfs and the tfligmertfetf rtitffWJt of the 
system, respectively, i.e. 


A = 


/ tttl 

*51 


T« E 


3|J 

*» 


- - «Jji 

■ - crajf 


and 


/“ 


Ml*) = 


“u 

a it Q JJ 


Vm 


Pi 


Li 


,i ■ ■ « *- 

DF FI hi IT I ON 1.6 .4 p jrr^yp/e (jt,, .. . , jc r| ) which satisfies each of the 

m equations in the system (4) is called a solution of the system. Two 
yjfems of linear equations are equivalent if even' solution of p tie 
system is j solution of the other system and vice versa. A system of 
linear equations is coiled a homogeneous system if ^ = 0 [i _ i t . . , m). 
A system with at least amt solution is called a consistent system. The 
Si >luiivn (0. . 0) of a homogeneous system is called the trivial 

solution. 


Our mam result is the following: 

THEOREM 1.7 If (A 1 16') = i is an rn x (r? + 1) matrix 

obtained front the m x (ti + I) matrix iAlb) by an elementary row 

r\ 

operation, then the s vs terns I % x. -&At= 1, and 

1b, I f 1 

FT 1 

E Off Xj = J3j' (i = I P « ■ -, m J are equivalent 
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PROOF We first note ihai if a -matrix Ml 6^ is obtained from a 
matrix (A\,b) by an elementary row operation, then there exists an 
elementary row operation on M'fV) which results in the matrix {A\b), 
this is the inverse of the original elementary row operation, T lie 
inverses of the three elementary row operations 

(i) r f -*■ or,, * ^ 0 (ii) r { .-* r f + ar f and (ill) r { +* r f 
are 

(i>' r t -+ a ‘ 1 ff (ti) J f/ ■* r f — ar f and (iii )' r t ** r } 

respectively. Also, whatever elementary row operation ha? been used to 
obtain the matrix M # |6 r ) from {A ji>) ± the resulting corresponding 
system of linear equations is a linear combination of the equations in 
the original system, and so. a solution of the original system will also 
be a solution of the new system. For example, for an elementary row 
operation of type (ii) T the only equation changed is the rlh equation, 
where the equation 

+' ♦ + 
is replaced by 

Ki + + * - + + «W* B = $ + 

and thus, if (x } , ., . ,.x ) is a solution of the original system, it is also 
a solution of the new system. Conversely, by the above, each solution 
of the new* system can similarly be shown tq be a solution of the 
original system. 

There are some important consequences of this theorem which 
appear in the following corollaries. 


COROLLARY ] // E q„ jt= j3 y (i = 1,..,, m i is a system of 

y=t 

linear equation with augmented matrix (A 16}« (citify) and 

n 

{R is)- (p if Iff,} is its reduced echdon matrix , then E p t -x f = o i IV = 1, 

H 

... ,m)is equivalent to E a ij x f = & ( [i= 1., ,., m h 

t~i 


PROOF By Theorem I,.5 the matnx (R js) is obtained from the 
matrix (A \b ) by a finite sequence of elementary row operations. The 
result now follows directly from the above theorem. 

It is useful to look at this result in mote detail. Suppose that m the 
reduced echelon matrix (72! r), the leading elements appear in columns 

10 


/ 1 ,/ a ./$, and that the remaining columns ire . f n , then 


V 


n 

2 

Jtsfi + 1 






it 

X k + I 
te-g+1 




Oji 


0 = o 


e+i 


where £ + 1 <m. Then, eiLher 

(i) — 1 and o t - . , . = — 0 . in which case the system is 

mrcomment \ q f , 

(ii) u £+ l = 0 and the system is consistent, i.e. the system has a 

solution and this solution may now be writ ten out explicitly by giving 

arbitrary values to* , r ., ,x t . 

7 ht+l 1 ' fn 

If £ = n, then the system has the unique solution jr t = Q lr , . « p 
jt„ - o n and if a < n r there is an infinite number of solutions. 

Thus, the method not only decides whether or not a system has a 
solution, but if a solution exists, ii gives a practical method for 
obtaining that solution. As a resull of the above we can now state 

COROLLARY 2 A system of linear equations is consistent if and 
only if the reduced echelon matrix of its augmented matrix has no 
leading element in its last column. 

COROLLARY 3 If m < n, then a homogeneous system of m linear 
equations in n variables lias at least one non-trivia! solution //£ = n r 
the trivial solution is the unique solution 

COROLLA RY 4 A sys tem of n linear homogen eous eq nations in n 
variables has a non'trivial solution if and only if its reduced echelon 
matrix R * 4 , where j n is the n » n matrix with / in the (i, i)-positions 
ti- 1 . ..., n} with zeros elsewhere, 

PROOF If R = / n , then the system reduces to x t — .. , = x n = 0, i.e. 
we have ihe trivial solution. 

If J? * / r)1 then f? has a row and column of zeros, i.e, £ < n and by 
Corollary 3. the system has a non-trivial solution. 
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EXAMPLES 

U Solve completely the following system of linear cquatiuns 
5* 2 + 35JCj “ 24** = 1 

2X| + * 3 — * 3 + jc 4 = 0 

3 *, 4-2 * 3 + 2*3 — *4 = I 

5*, + 3* 2 + * 3 = I 

The augmented matrix of this system is the matrix 12i of the last 
example in §1,2, which is tow equivalent lo the matrix (3). I Jills, 
this system of linear equations is equivalent to the system 

= 26 

Jts + 7x& — —43 

*4 - —9 

or 

x r = 4 * 3 + 26 ,*! = — 7 * 3 — 43 , = -9 

Put * a = X, then Hie general solution is 

(*!, je 1+J x a ,**} = (4X + 26. —?X — 43, X. —9) 

where X may be given arbitrary values, 

2. Solve completely the foElowing system of linear equations 

JCi“ *j + - 0 

*! + * 3 + 2*3 = 0 

*t + 2*J - *3 — 0 

The matrix of coefficients of this system b 



By carrying out the following elementary row operations, wc obtain its 
reduced echelon matrix 


/' 


\i 



■ r, ™ r , 


1 I 

2 I 

3 -2 



which implies by Corollary 4 (hat the trivial solution* t =*j = jr 3 
is the unique solution. 

3 r Fur what value of k will the system 

2*r + * 3 = 5 

*1 “I*! = “I 

3*1 + 4*3 = k 

be consistent'? 

For that value of fc, find the complete solution 

12 l S\ /1 -3- “I \ 

I r i" f l 

1 "3 -1 -| 2 3 S 

\3 A k! \3 4 ; k / 


r, -r 1 - ir, 


r t 3fi 


n -i 

- 1 \ 

0 

7 

7 

\,0 

13 

* + 3/ 


r t “4r s 


F i“ Hr. 
r t + 3r- 



k - EC 


13 
































Thus, by Corollary 2, the system of linear equations is consistent if 
and only if k — 10 - 0, he, k = 10. If k = 10, the reduced echelon 
matrix is 



n 

0 1 

i 

\o 0 

0/ 


and the solution ts.T] - 2, jr^ = I 


Exercises 13 


1. Solve the homogeneous systems of linear equations with the 
following matrices of coefficients 

(i> iz - 1 i o i\ 

1 2 —l 2 I 

\l -8 5-6 -1/ 



2, Solve thenon-honiogtotous systems of linear equations with the 
fo]lowing augmented matrices 


(0 (2 

-i 

0 

I 


(«i) 

(* 

1 -1 1 

2 \ 

- 

i 

2 

1 

5 


-I 

0 

2 5 

3 

\ i 

0 

2 

2 

4/ 


^ 2 

1 

1 6 

2/ 
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(iii> / 2 I 

5 4 

I 0 I 

\-l 1 

(tv) j 2 0 

-I 0 
1 1 
\ \ I 


-I 1 I 

2 4 4 
I 0 2 
5 J I 



1 -1 I 

2 3 4 

0 -1 1 

5 4 10 


4 \ 


3. hind the conditions which ~k and jr must satisfy foi the following 
systems of tinea: equations to have (i) a unique solution. (|j) no 
solution, (iii) an infinite number of solutions 

(a) lx + 3y + * — 5 

3 jt — y + Zi = 2 


x + 7y — - fj 

(h) Jf + y ~4z = 0 
2* + Zy + z - J 
4 x + 7y + Xs = y 

4. For what values of X have the equations 
x + y + z = a 


Xi + 2y + i = h 

\ J x + 4y H »ir 

a unique solution ^ In the exceptional cases, find the conditions to be 
satisfied by g, b.c in order [hit a solution may exist and find the general 
solution. 

5. Determine the values of X for which the following systems of 
equations are cons is tern and for those values of X find the complete 
solutions 

0) 5 * + 2y - t = 1 {&) x + 2y + Xf = 0 

2x + 3/ -f 4z « 7 2 jc + 3y — 2z = X 

4jr — Jy 1 4 Xr = X — 5 Xx +y + X 2 z 33 3 

IS 





















■S3 'T 


(iii) x + 5y + 3 - 0 
5x + y-A = 0 
„t + 2y + A = Q 


Civ) 2* ■+ ty + r + f = 0 

x + 2y 4- t — t - 1 


3j + 5y + 2 z + t = a 
6JC+ IOv +42 + i = (X + n 1 

6, Find the complete solution of the system of equations 

y + i+ u + = 2 

- x + 4y + 3i + 3u + 4v = 7 

3* + y + 3z + 2 h + Sv = 3 

3* + y + 42 - u + 4t) = 0 

5x + 2y+ 7f + 1 Of) — 2 

7. Solve completely the system of linear equations 

Jti + Jfj =0 

Jfj + Jf } +Xj =0 

jc 2 +j t$ + x 9 - 0 


Vj + Vi + V i 

H - I J. 


when {{> « — 8 (ii) n -9, 


0 

0 

0 


J -4 Matrix A Igebm 

DEFINITION 1.8 EQUALITY OF MATRICES If A = {*.,) is an 

m x n matrix and B ~ (fy tisa p ■ q matrix then A = B if and only if 

m-p t n = tf and .. n)< 

Zero Matrix The m > n matrix 0 — (G- r ) such that tx i( — 0 

ii - I.fft; / = K -.,, n i is called the zero matrix. 

Matrix Addition If A = (a (|l ) is an m ■ n matrix and B = \ is a 

py. q matrix then A + B is defined if and only ij m — p r n = q and then 

A + B = (Oty + fly} 

them x n matrix obtained by adding the corresponding elements in 
and B. 
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Scalar Multiplication If A = i, u ;i \ is an m x. it matrix mid a. t K. then 
OlA - (OBy) 

is the m x n matrix obtained by multiplying each element of A by a. 
aA is called the scalar multiple of A by a. 


EXAMPLE 

/l 2 5 


\ (0 1 

“t\ jE+0 

2 + 1 

5- 1\ 

K 5 

-3/ U+2 

4 + 5 

6 - 3 ) 


t 

-c: 3 

n o\ (i -j n 

but + 

\2 I J \2 35 

(l 2 S\ 

If A = \ and ff = ”2, 

U 4 6 

’H 


is not defined. 


then 


i-2 -a 
, “-6 “6 


10 

12 


The definitions of matrix addition and scalar multiplication are the 
expected definitions for matrices, hut as motivation for matrix 
multiplication, we consider the following. 

Suppose that we have the following systems of linear equations, 

y, - rknJfi + a a ** + fij S *i 

( 5 ) 

y a = a 3t *1 +tk lJ je 1! + ft 3S Jc a 

and 

= 011*1 + fa*2 

( 6 ) 

x * — z i + ^3i J i 

Then, substituting (6} in ( S') gives 

y\ - + 0 fl *a) + *12^1^1 +jS 13 r a ) +ttu(|3 at 2 1 + j3 Sa r a J 

= K«I i ^31 t; + + a,)j3 3 ,jj, + (flj[|3]a + + Qfw^aa) 1 ! 

Vj - + + + *Tatfai4t+^3J?2) 

= (ttaidu + + ■ Q£ ia^3i)? i + + &i3h3ii + 
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or in other words, if A — 


« si 


*13 

*11 


*1J 


I $|| $tl\ 


and B — fin fi 2 j 
\fin fin/ 

are the matrices of coefficients of the systems (5) and (6) respectively, 
then the matrix of coefficients of the resulting system, which we shall 
denote by AB , is 

I Q n $u + + *1* $Ji a n $ii + *H fin + Q is-$3j' 

.Qjl $[] + @22 fit L + *33 $31 a 1l fin + *33 $33 + *33 $33 


That is, if A is a 2 * J matrix and B as a 3 x 2 matrix, then AB ss s 
2x2 matrix. Note, for example, that the (J h 1 Element in AB has been 
obtained by multiplying the elements of the firsi row of A with the 
corresponding elements in the first column off? arid suniming. 

We use this now to give the following definition of matrix 
multiplication. 


DEFINITION 1 .9 If A is an m n n matrix and Bis a p x q matrix 
then A B is defined if and only If n — p and then AB is the m x q matrix 

AB = (J^M 


that is t the (i t fyetement of AB is obtained by multiplying the elements 
in the Uh row of A with the corresponding elements in the fih column 
of B and summing. 



fan 

- ■ 

■ “IF, \ 


f $n 

$13 ■ ■ 

• iV\ 

f.c. If A = 

*ai 

*33 * ♦ 

* *2n 

and B — 

$at 

$33 - - 

■ h, 


\ ^mi 


k } 

/ 



fin2 ■ ■ 



then 


( *ll$ll +(*12 021+ ■■■ '•■“ lrt $ rr |ttll^l3+ a li$33 + --* + *i n i 3 nl- 
* 2 j$ii + *ia$it + + «aii^i “iifta + a u$ai + ■ - + *a n 0*ia * 

‘ 

IS 




The system of m linear equations in n variables £ x • - j3j 
(j = 1.ffl) can he expressed in matrix form a $AX = fr r where 


A = {a if ),X = 



b - 


EXAMPLE 
LeiA- 
is the 2 x 2 matrix 


-e: -’) 


and B 



then AB is defined and 


&1+1-1 + 3.2 2.0+ 5,1+ 3.1 \ = / . 

\U + 2-1 + -1.2 1.0 + 2,1 + -I. I ) 


BA is also defined and it the 3 x 3 matrix 

1.2 + 0,1 1.5 + 0.2 1.3 + 0.“l\ / 2 

-1.2+ 1.1 —1.5 + 1,2 —13 + I.—I J = [ —1 

2.2 + LI 23+1,2 23 + L-l/ \ 5 



We note that AB and BA are not even of the same shape and (hut in 
general AB ^ BA . Even if A and B are of the same shape, AB ^ BA , in 
general, for example 



, then 

1 

1 


We have seen in the above example that one of the laws of algebra, 
namely the commutative rule of multiplication is not satisfied. In the 
remainder of this book, a great deal of our work will depend on the 
manipulation of matrices and Ft would be of interest whether or not 
there are any further restrictions on the normal manipulations allowed 
in algebra. The following theorem shows that there are not. 

THEOREM 1.10 If A = (c^), B - C - (y if ) are m x n, s x t arid 
p x q matrices respectively, then 
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(i) (Commutative Low of A dditian) 

A + B = B + A, where both sides are defined if and onfy if m - s r 

FT — 

(ill (,4 ssodative Law of A dditiofl) 

(A + fl) + C = A + i;i? + C] where both sides ate defined if and 
only if m= s - p, n - t = q. 

Cm) a +o = a. 

(iv) A + i~Ai = 0. 

(v i ssoeiative Law of Multiplication 1 

4(j9£*) - [AB)C where both sides ore defined if and only if n ~ s, 

f = P- 

(vi) (L eft ond Right DistrUmtiv e Laws } 

A[B + Q = AB + AC where both sides are defined if and only if 
s = p,t-q 

{B +■ OA = BA + CA where both sides arc defined if and only if 
I = p. I = q = rrt, 


PROOF We shall only prove (v>, the remaining pans are proved using 
a similar method. 

AB is defined if and only if n ~ s and is an m * t matrix, 

1.4 B I C U defined if and only if n =■ s, t - p and is an m x q matrix, 

BC is defined if and only if t = p and is an s x q matrix. 

.4<ifO is defined il and only if n = j k t = p and is an m * q mainx. 

Thus we see that {AB)C and 4(50 are defined under the same 
conditions and have the same shape. Using the rules for matrix 
null Implication, wc now further See lhal 


AB = 

/ n 
I 



\k-l 

•'ffllXf 

(AB)C = 

(i 

\v= 1 


BC = 

fx 



Ws 

' 1XQ 

A(BQ - 

( i 

1 \ 7ij 1 


mXtf 


mfij 


m (A A 1 **'**”*) 

= [AB)C 


m y. [j 


:o 


* 


♦ 


7 


But the reader should be further warned concerning manipulations 
□f matrices, as illustrated! by the following; examples 



that is ..-If? = 0, hut neither A nor B i&G, 


fii) .4ft =■ AC ¥* B — C 

i.e. A0 ~O = 0 can he true with A ^ 0 and H^C. 


Exercises L4 

I, Add and muluply the following matrices {if possible ) 

5 

\ 1 




Also test the associative and distributive laws on these matrices. 


2. If the matrix A = 


/a b\ 
ix A ={ 

\c d! 


commutes with the matrix B - 


-C 


:) 


show that b — c = 0. Hence show that i f A commutes wit h every 
matrix, it has the form 



3. Use the fact that a square matrix X commutes with X J to show that if 


X 1 


1 4 1 °\ 

0 4 3 

\ 0 0 4/ 
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’ 


fa b c\ 

ihen X is of the formj 0 a b ] Hence, find a]I (he matrices A" svtiich 
\0 0 af 

satisfy the above equation. 

/ 7 4\ 

4, 11^4 = ^ J , prove that for positive mEegral n, 

/ i + 6n 4tt \ 

\ -9ft I -&*/ 


1 + 6n 4. n' 

—9n I — <ht 

Verify that ihe result is true when n ts a negative integer. 


5. Find the most general real n :■ n matrix which commutes with the 
matrix 

'0 0 ... 0 IV 
0 0 . , h I 0 


0 J , < , 0 0 

.1 0 ... 0 0 


i .5 Special Types of Matrices 

1, IDENTITY MATRIX 

j I 0 D , . . 0^ 

0 I 0 . . + 0 

The n n n matrix . . . |is called the identity matrix. 

L - 1 

10 0 . 0 1/ 

denoted by I n or /, that is I - (a, f ), where a rV = 1 ,^ = 0 ( / i= /), 
h has the property that 

/(/„ = l„A = ^ 

for all pi x n matrices*4. 

2, DIAGONAL MATRIX 

I 

STie it x nmofred . 


X, 0 

0 Ai 


V eaMetf (J dfrgBW/ matrix and 


\G 0 , X. 


■*? 


(jfttf denarerf iy dtag (X.X fl ). 

3 INVERSE MATRIX 

If A = fotj-y i « err r; n matrix then an n x « matrix 5 swc/i riifff 
,45 = &4 = /„ 

tl called an Inverse of the matrix A. 

LEMMA ], I ] The inverse of a matrix is unique 
PROOF Let C also he an inverse of A , then 
AC = CA = ; n 
and 

C = CI n = C(^e) = {CA}B = I n B = B 

The unique inverse of A is denoted by /t”\ 

A nutrsx A which has an inverse is called a non-singular or Invertible 
man i>, and if it lias no inverse, it ls called a singular or nort-iavertible 

matrix. 

L F M MA .12 If A and B are invertible n x n matrices, (hen AB is 
im cable and 

PROOF li A and B are invertible, then AA l = i H = A~ X A and 
3ET- = I = B~'B, Now 

UjSK^'.-r’) = J„ = 

and jo AB is invertible and since this inverse is unique by Lemma 1.11, 
we hive 

{ABf 1 = l!) 

Later m (has section a method of calculating the inverse of a matrix 
will be given and for determining when a matrix is non-singular. 

4, TRANSPOSE OF A MATRIX 

If A - fa jr ) is an m x n matrix, the transpose of A is the n x m 
matrix denoted by A 1 obtained by interchanging the rows and columns 
of A, shat is 

A' = (0,y) 

where fly ~ a- f {i = I,.. , p it; / = I r , « , . m). 
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EXAMPLE 



The following will he useful in l^t 


LiiMMA 1.13 If A anti H are m n and p v. q matrices respeemei} 

then 

(i) {A + &)* — A* + B i , where both sides are defined if and only if 
m = p,n — q, 

(ii) (AB) 1 - B ! A r , where both skies are defined if and only if n = p. 
1’ROO F We sh all prove (ii} on I y. 

AB is defined if and only if = p arid it is an m x q matrix. Thus. iAB\ 
is defined if and only If n = p and {ABf is a qx m matrix. Similarly 
B t A t is defined under the same conditions. 
it A =C« !( )»>x«. ir “fAy). x , the" 

lABf = ( V <*,*(!„)’ 

Vifc=l f 

q 

where y ;j = Z ft,* V 

ft — 3 

itA * = i% > ji x m < Bt = (ft/' r1 ■ lhen 

m = ( i ft>;\ 

U=1 )qx„ t 

- iAsy , as required ^ 

COROLLARY If A A Jt .. ., A k arc k matrices ruck that A ■ +1 tm 
the same number of rows js A r has columns {i = l f L , , T k — 1 ), then 

(A t A 2 ... A k y = AlAl-i ... Al 
PROOF Use induction on k 

LEMMA U 4 If A is an n x n matrix then A r is invertible if and truly 

if A is invertible. Further ( .4" ) 1 — [A~' 1* 


PROOF If A is invertible then A A * l - 1^ = A~ [ A f transposing gives 

t,4"Y A* = 4 = A f (A~ i y and su^l f is invertible. The proof of the 
converse is similar. The above also implies by Lemma Mi thai . 

[AT = iA^y, I 

5 , SYMMETRIC,SKEW-SYMMETRIC AND ORTHOGONAL 

matrices 

An n x n matrix A is called 
ft) a symmetric matrix if4 J - A 
{ii I a skew-symmetric matrix if A f = —.4 
fiii) an orthogonal matrix if ,4(4 — A A 1 - 4 , 

EXAMPLES 

fl & c \ 

b d e is a symmetric matrix 

c e ft 

j 0 a h\ 

and I -a 0 cl 

\-b -c (V 

n 2 i\ 

and H 2 i -2 

\2 -2 ll 

Remarks 

L la a symmetric matrix, the elements arc symmetric about the 
diagonal of the matrix. 

1 In a skew-symmetric matrix, the diagonal elements are all zero. 

. [f A is an orthogonal matrix, then A r is its inverse. 

Exercises 1.5 

I, If .4 is an n • n matrix, prove that 
11 ) A ! A is a symmetric matrix, 

r sj i A + .4 f is a symmetric matrix and A A 1 is a skew-symmetric 
matrix 

(iii) ,4 is the sunt of a symmetric and, a skew-symmetric malnx. 

2 If .4 and B are symmein-. and skew-symmetric matrices respeclively 
and AS = BA and ,4 + B is non-singular, prove that the matrix 

i,4 + 5 )’ 1 (4 —£\u orthogonal. 

3, Show rhat. if / + SA is nan-singular, where A is a symmetric matrix 
and S' is a skew-symmetric matrix, then the matrix 


is a skew-symmetric matrix 


is an orthogonal matrix 
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L = (l-SAH+SAf 1 

is such that L*AL - A. Conversely, &1*AL = A , where ,4 is symmetric 
and I + L and A are non-singular show that J — (1 + £)"' it “ ^ 1 A ^ 
skew-symmetric. 

4. If /\ a a 2 tl\ 

A{a) = f 0 l or J 

\0 0 1 / 

show that - A(a + &)> Hence, find ihe inverse of 4(a) 

Show thel 

AQ a)- 1A{2&} + = I 

and hence find a cubic e qua lion satisfied by A {a)., 

5. If A is a real matrix, express the sum of the diagonal dements of 
A*A in terms of elements of A. Hence, show that if A<B arc real and 
symmetric and C is real and skew-symmetric then A J +■ if 2 = C 1 
implies A — B = C= 0, Does this conclusion still hold if.4 is not 
necessarily symmetric? 

6 . Prove that every 2x2 matrix X such that X l AX = B. where 

A - B = ^ ^ lias one of the forms 

(“ K ') or / ° f\ 

\a “Jof 1 / V~Ot J a 1 / 

Find all the matrices X which satisfy ihe additional relation X*X - / 
1,6 Elementary Matrices 

DEFINITION 1.15 ,4ft n x n matrix is called an elementary maffix 
If ii can be obtained by applying an elementary- row operation J 'a 

'Unis, elementary matrices are one of the following ihiee types 
corresponding to the element ary row operations r { -+ r i *? /v, 
r t -*r f + ar f respectively: 
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where every ;ther n ji-Jiagond element is zero, 

Sz VIM \ . > . /•"a n m x n matrix B can be obtained from an m * n 

nu 4 applying an elementary row operation, then B is equal to 
the product of the corresponding m k m elementary matrix with A 
ie if e is the element an row operation 

U t FM 4 ■' 

B = eM) = r(./„M -* 

nJ 

■ U ■ Ei ery elementary matrix is invertible, the inverse of each 
eiemenPir- matnx u eiemenutry. 
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PROOF (i) and 00 are proved tn considering each separate type, 
(i) r, ■+ ar { then 

ttjj . . . 5m \ 


t 


M i (a)A = 


l'i 




. , . CtCt 


in 




or 


\! \j 


. yx 


/“, ■ 

■ - *11, \ 

♦ a i„ 


*Si 

<XXin 

■! 
■ °Wfj 


[ : 

1 

" * ) 


and similar!V 


'a,, . . . Oj, ' 


r: 


T\ 




ftfj 4 4 4 *j' rt 

* j 

a " ‘ ■ C ^rt ft 

'*11 ■ - ■ a E 


and A^i&yA = j a ri +*a jiJ . . . 


\ 


7« 


X^wtt 




IB 




- 


(ii) Fot this part verify that 

Wiwr 1 = - W ,Q). c h v p = H t , 

and (A 0 (a))“* = A f/ i ~ct) 

EXAMPLE 

/ I 0 t \ 

F . “* F • 2,t~* 



(' 

0 

If A = 

, 

-1 

[ 

j 


0 

then 

1 

0 

-1 


U 

1 


/ 1 

0 


1 0 O' 


- -2 


0 / 


Also 


0 0 1 


l 0 = 


\ 0 0 


0 

-I 

I 


,0 0 1 



1 

-2 

0 


o r 


We are now ready to prove the main resuJ( in Ibis section. 

THEOREM LI 7 If an m X ft matrix A is row equivalent to an rnx n 
matrix H, then there exist a finite number of elementary matrices 
£ ir £ a , . . . , E k mch that 

B = E x + *, E k A 

F R(■>F in Theorem 1.5, we saw that B can he obtained from A by a 
fiiuie ii> k. ^.jLience or elementary row operations. The proof is by 
induction : r k It A = L then by Lemma 1.16 (ij B — E\ A for some 

dpcmeajttry matrix £ 5 . 

If ■ ; - - assume that if a matrix H' can be obtained from A by k— 1 
elementary row yparadoni, then there exist elementary mu rices 
£ 2 ...£* such that 

S' = E % ... E k A 

N.. a B \i ob limed from B' by applying one further elementary row 
operation uid by Lemma 1.16(1) 

B “ E X B* 
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for some elementary row operation £", and thus 

a = eae* ,.. t' k a} = E i E 1 .,.E k A 

as required. 

There are two important corollaries to this theorem. 

COROLLARY ] If R is the reduced echelon matrix of A, (hen there 
exist a finite number of eitmen titty matrices £ . . ,E k such that 

A - E v Ej *..E k R 

PROOF By The ore m 1.17 there exisl elementary matrices E t . E k 

such flUl 

r = e;e 2 ,.. e;a 

But, by lemma, 1.16 (Ii), each elementary matrix is nomsingular and its 
inverse is also an elementary matrix Thus 

A - % k'*:\„"Ei' l R 

as required. 

CO RO L L A RY 2 The following statements are equivalen t. 

(i) the n x n matrix A is invertible. 

(ii) the homogeneous system AX = 0 of n linear equal ions in 
n variables x it ... ,x n has no nontrivial solution. 

till) .4 is a product of elementary matrixes. 

PROOF (i) *(ii) If A is invertible, the system of n linear equations 
in n variables given by ,4J( = 0 has no nontrivial solution, since then 

X - {A^A) X = A _x {AX) = A' 1 (0) = 0 

(iil ^fui) By Corollary 4 lo Theorem 1.7 the reduced echelon 
matrix of A is l n and by Corollary 3 above 

A = t\ .,. E k 

is. a product of elementary matrices, 

(iir) =* (i) li A =f|L,., £" fc , where each E i is art elementary matrix, 
then since elementary matrices are invertible, then by Lemma 1.12 

.4~ a = Eff +1 . £7' 

andj4 is invertible. 

Hence in order to determine whether a matrix is invertible or not we 
note that if the reduced echelon matrix of 4 is R and 
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(i) if R = t n , the matrix A es Invertible. 

(ii) if J? contains a row of zeros, then J is not invertible- 

This corollary is important in that it gives an explicit method for 
calculating the inverse of an invertible matrix. If A is noti’Singulai, then 
the teduced echelon matrix of A is the identity mairix. tfifi, . , . ,E k 
are the elementary matrices which correspond to the elementary raw 
operations which must be performed on A to give l ft 

i.e. l n - E k h.EjE^a 

then A = £7 1 E^ 1 .. , Ef l l n 

and A~ l = E k . ,. E 2 E 2 I n 


That is.,4" 1 is determined by applying the same elementary row 
operations as were used to obtain I ri from A. 


EXAMPLES 

L. Find the inverse of 


-I 

2 

! 



n -i 2 

3 2 4 

\0 I —2 


1 0 0 



r ,-*,-3^ 


-> 


(\ 

0 

^0 


—! 2 

5 ~2 
t -2 


1 ° °\ 
-3 10 
0 0 1 / 



I 0 0 
0 0 1 
-3 I 0. 


r.-r. * r. 


r,- r 1 - Sr, 


p 

0 

0 

I 

0 

»\ 

0 

i 

2 

0 

0 

1 

V 

0 

8 

-3 

I 

-si 


r, -* |r a 




/' 0 0 

I 0 1 —2 

\G 0 I 


10 1 \ 

0 0 I 

-i i -1/ 


( l 0 0 
0 1 0 
0 0 I 


1 0 I 

-I l -i 
-i i -i 
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I 0 1 

therefore 4 1 = | —| k “1 

\“i i -i 

2, Are the matrices 

/ 1 0 

G) A - 


-I 1 

\ i I 



Envertiblc? 







n o i\ 
0 1 0 
\Q 0 1/ 


iiild thus 4 is invertible. 


/I 
I 0 
\o 


0 I 

1 3 

1 3. 


'1 —1 

3 
1 


Exercises 1.6 

J. Find inverses; (if they exist t of the following matrices 


i\ 0 O' 

0 I 0 

\o 0 1 





1 


I 



(vi) 


where j - v^T- 


(v) / o —i 

-4 3 

I 0 

r 1 1 


2 

-3 5 
0 -I 
0 I 


/• 

2 

-3 

l\ 

(vii) 

/' 

' °\ 

2 

4 

I 

3 


i 

“i i + iL 

-1 

1-2 

3 

2 

I 

-5 

Q 

-I 


v-» 

0 2 / 


1.7 Elementary Column Operations and Equivalent Matrices 

Most of the material in this chapter has been developed m terms of 
elementary row operations., Jt is Clear that the definition of elementary 
row operations (Definition 1.2) anti row equivalent matrices {Definition 
1.3) may he adapted in an obvious way to define elementary column 
operations on a matrix and column equivalent matrices. 

In Theorem l.t 7, we saw that if R is the reduced echelon matrix of 
an m x n matrix A , then there exists an invertible matrix P such that 

PA = R 

indeed, it is easy Eo calculate P, Since by Theorem LI 7 1 
R = EjE\ ,. + E k A 

where E^. £ i _ l . . . E L are the elementary matrices which correspond 

:: a.zztn:t :-i eismentary row operations which are carried out 

i . i ss^velv in order to obtain R from A. Thus, we have 

P = EtEj ...E k 

= £ 1 a x { ..E k . 1 i£ k lJ).. r ) 

: : ::■£ malm P ts obtained by applying to/ m the same elementary row 
operations as were used to obtain H from A (c.F, the method given lor 
detenu mini the inverse of an invertible matrix in §1.6), 
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EXAMPLE 



n 

-i i 

0 / 

Theorem ] .5 and Theorem 1 . 1 7 have their equivalent statements in 
terms of elementary column operations In particular, we can prove 


THEOREM 1.18 If an m x n matrix A is column equivalent to an 
m x n matrix H, then there exist a finite number of elementary* 
matrices ^ E 6 _ such that 

B = AEt£ 2 


Following the above argument. we see that there exists an invertible 
n x n matrix Q such that B - AQ. 

We apply this, in particular, to the reduced echelon matrix fi of an 
m x in matrix A. Suppose that the leading J's appear in columns 
}\J 2> , „. J f , then by subtracting suitable multiples of these columns 
from succeeding columns and then the column interchanges C| — cy 
c 1 **c h . ,.., c t **Cj „ we have that R is column equivalent to the matrix 


34 




fym-r)Xr 



■V = 


w r here is the r >, r identity matrix and G pXc is the 2£ro p X q 
matrix. In other words t we can state this as 

THEOREM 1.19 If A is an m * n matrix then there exists an 
invertible m x m matrix P and an invertible n y. n matrix Q such that 

FAQ = N 

where N is the matrix given above, 

As explained above, the matrices P and Q are easily calculated as 
illustrated in the following: 


EXAMPLE 

12 -1 
I (A =11 2 



we have seen in the preceding example 



/ 

1 

o i 

i' 

\ 



PA 

- 

0 

! 1 






\ 

0 

0 0 

oy 

/ 



we have 








! i 

0 

1 

* 


i 

0 

0 


0 

1 

i 

-i 


0 

1 

0 

0 

0 

0 

0 

0 


0 

0 

1 

0 






0 

0 

0 

Jj 

I 1 

0 

0 

0 


a o 


-1 

-t 

0 

I 

0 

0 


0 1 


-I 

i 


0 0 0 0 


0 o 
0 0 


C|- E?, - K 

r c i 

e* “ r j + \ c. 


0 

I / 
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then 


/] 0 

* ndifG “(o 0 
Vo o 

/I 0 0 0 

FAQ = 0 I 0 0 

\o 0 0 0 

This leads us to make the following 

DEFINITION l .20 Two m v. n mar rices A and H are equivalent if 
there exist invertible matrices Pond Q such that 

FAQ = B 

l Lis is easily shown (o be m equivalence relation on the set of m x n 
matrices over a field K t since any m > n matrix is clearly equivalent to 
itself; if FAQ = B then P' tlQ l = A. and if FAQ = B and P'BQ’ = C 
then {F F) A{QQ‘) = C, What we have proved above is that every tn ,r n 
matrix A is equivalent to a matrix with the simple form A r . where r 
denotes the number of non-nero rows in the reduced echelon form of A. 
N may be regarded as a canonic*] fomi of A under this equivalence 
relation, that is. a representative of the equivalence class which contains 
A under this equivalence relation. La Ter, in Chapter tV {see Corollary 
to Theorem 4.20}* it will be seen that r is the rank of the matrix A. 

N is called the normal form of the matrix ,4. 



Exercise 1 ,7 


1. Find invertible matrices P and Q such that FAQ is in normal form 
for the following matrices vt 


(0 

Lib) 


fl 0 

“1 

(ii) 


2 

-1 

0 

1 

\ 


\l 3 

l) 



I 

1 

-I 

1 






L 

-1 

1 

2 0 

/ 


j 1 0 

-1} 

(iv) 

/ ^ 

H 

0 

1 

»\ 

2 1 

2 



-2 

0 

2 

3 


-1 3 

1 



1 

2 

0 

0 

3 

\-l 0 




H 

1 

—2 

-2 

0i 


3& 


2. Determine which of [be following matrices arc equivalent 


(i) 

1 

-l 

1 

2 \ 


0 

] 

2 

0 


li 

0 

3 

2} 

Oii) 


-1 

0 

1 



1 

I 

-2 


i 

1 

3 

-4 

(v) 

/ ] 

0 

-1 

l \ 



0 

2 

1 


\ 0 

0 

1 

it 


(ii) j 0 | 0 -2\ 

0 -3 0 2 j 

\0 2 0 -4/ 

(iv) j-l 1 0 I 

2 0 3 1 

\ 1 12-1 













CHAPTER 2 


Determinants 


Let M n (K) denote the set of all w x n matrices over a field K 


2A 2 x 2 and 3 x 3 Determinants 

We shall first motivate our discussion of ra X pi determinants by 
considering 2x2 and 3 x 3 determinants. 

Let /J - f“ JI Blt \ EMgtf}, then define det ; M 7 (K)~ K by 
\toii 

det A — ii M Qj 3 — qjj crj] £ A' 

The determinant function arises naturally ip tlie solution of linear 
equations, for consider the system of two linear equations in two 
variables 


«it*i = Pi 

<*11 *J + «Il*2 = 0s 


then 


*1.2 01 ngjjjj 

*11 *52 Q 13 *2L 


and 




_ ttjlfll *1101 
* 11*21 — ffii flu 



del A 


The following properties of the determinant function are easily 
verified 


[1) det ^ 


*:i + 0?] 


a n * 0j 


) = dei( a ' 1 ° M \ + det(“ 

:/ \®ii *15/ 10 


a n 

023 


i.e. a 1E (a 13 +iSjj)-Qi 3 (q 1i +0il)= tQ,,Oaj ft j: a 3j ) 

+ C«n03a - *ii03i)- In other words, if r, = (<*,,, a^ t r 7 = (a,,, a H ), 
r % = (0n.02i)i then 


3S 



Similarly t the following are also easily verified 

(ii) det = a del for all a E A r , 

(iii) det ^ = del J, for all a^K 

<w dc1 (r|) = 0 

(vi) det “) = i 
(vli) det A 1 — del A. 

(j) and (ii) imply that the determinant function is linear on the rows 
o f A , that is 



(vii) implies that statements (iM v > can flJso be for the columns of 

the matrix A , for example 

det(fj + o' r[ f <* a ) = det (o, t c$ 4- * del (ci fj) 

Not all of the above results arc independent as will be seen later 
when we consider the general case. The above properties are aiso useful 
in evaluating determinants, although it should be emphasized that for 
2*2 matrices the evaluation can be performed easily by applying the 
definition directly, as for example in 

det ( * 3 = xy* -x\v = xyiy* - x% 

This determinant may also be evaluated by applying the above rules. 



= xy O 7 - * J ) 
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by (ii) 


by (iii) 














We now consider the case of 3 x 3 determinants. 


Let A — 


/an °u tt t3^ 
*jl aja 
Qj t (Xu CKjj^ 


■ M 3 {K), Then define del : M 3 (A'} -*■ A 


by 


del A = ft; ] Oh f5£ 33 + a ,j a ti a 3 j + a ia a?j ffc M a | ] Qjj a 3 ? 

Q ]j Q ti a 3a — Qjaa 3a a 3 i 


Although there are ways of rciEmonzing this formula, it is not pleasant 
to use for the actual evaluation of a determinant. Bui again the 
properties (i j-fvh) suitably adapted, art valid in this case. 

In addition, if we leL A i; be the 2x2 matrix obtained by deleting 
the rlh row and /th column of A (ij = I T 2,3) then 

(vLi) det ,4 - an det.4n — tt iX det j4h+ ftu del>l 13 
= —a 3 , det.4^ -I- a 21 deldel A jj 

— c< 3 i det. 4 a , — o sl det ^33 +• ct 3a del A 33 

- cr,i det An — at* i del j 4j| + a 3i del A st 


— 11 de t A ij + Of a j de 1 .4 33 a-ji de 1 .4 a 3 

= oc^ del 4 u — (¥33 dei A 23 4 - or 33 det .4 33. 


These equations are verified by expanding the right hand side in each 
case,. for example 


a,! det .4 ]( — ctijdet .4 ]3 + a i3 det An 

/*r Qjj \ i<x21 a 2J i i&2 1 a J3 

- a,, det ( — a t3 det 1 + 0.13 det I 

a 33 / \a 3l O 33 / \a 31 ct^ 

= 1(^32*53“' *23 *32J ~ O'E5 (021*33 ~ 0-23 ®3l) + ** LJ C^21 *32 

— *22 ®3J.) 

= det A 

To illustrate the above, we evaluate three examples. 
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EXAMPLES 


1. 


3. 


by subtracting 2 x 
row 2 from row 1 
and adding 3 x tow 
2 to row 3 and 
using (iii) 



— (y — aXz — a) det 


= Op-aXi-aXi-J') 

'»+* 1 *\ ( x+y * 1 J 
dell r+A y > ,J 1 = del jc+>+z y y 3 


ia + y 


'E x 

= U + y + z) det I 0 y-x y*-x 


+ >' + Z Z Z 1 
3 


* 


^0 Z - A f 
- (A 4 - y + z)(y — x)(z — A) det 


A 3 . 


/I y 2 + jm + .X 3 ' 

\1 r+JA+A 1 , 

/! y 2 +yx + x 2 \ 
(A+> + 1)0*—*X*-*>d*t _ a ) 

\0 z* —$r + (z —y)xf 


= (a + y + if iy-xti - *X* ~y) 


4 ] 










Exercises 2.1 

In the following exercises WC Write ,4i for del A. 


1, Evaluate the following detenu tracts 


(i) |3 2 

fii) 

2 

0 -1 

(hi) 

4 5 


1 

2 

2 




3 

2 

4 



(iv) 

-2 1 0 

(v) 

2 3 1 


5 0 1 


1 0 1 


0 2 2 


3 3 2 


I 2 

1 5 

2 3 


2. 


Evaluate the following determinants in factors 


(i> 

a 

b + c 

a 1 

(ii) 


(b + c? 

be 


b 

c + a 

b 1 


b 1 

(c + ffj 3 

ca 


c 

a + b 

c J 


c 2 

{a+bf 

ah 


(iii) 

b 2 + c~ 

{h-cf 

a 3 + Ibc 


c 3 +u 2 

(c-af 

b 2 + 2 ci? 


a 2 + b 2 

(a-bf 

c 3 + lab 

(iv) 

{*-*? 

(jc + a) 2 

2y 1 + h 2 


(y-af 

O + tf) 2 

2 z 1 + 2x 3 


(l — of 

(z±a? 

2* 3 + 2y 3 


(v) o(&-fc) (p + cf a 1 — 2bc 

b(c + a) (c + a) 3 b 1 — lea 

c{a + b) (a + fr ) 3 e 3 — Tab 

3. Find the genets] value of 9 which satisfies the equation 
l + sin 3 9 cos 3 9 4 sin 2 S' 

sin 3 0 1 + co* 3 fl 4 sin 2 8 


sin J 


cos 3 B I + 4 sin 2 & 


= 0 
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4. Solve the equation 


(T X b — -V C 


tf — JT C 

ir b — x 


b —x 
€ — x 


= 0 


12 it xn Determinants 

In the previous section, we saw that even for the case n - 3, the explicit 
expression for the determinant of a matrix is very complicated. It was 
shown that in the evaluation of determinants the explicit form was not 
important, for the expansion of determinants the properties of 
determinants were exploited. For higher values of u, we seek a function 
which has these desirable properties, in this section, we show that such 
a function exists and is unique. Our main result will he to prove 

IHEO REM 2.1 If A = \ a^) = (r,, r a . r„) £ At a (Jt), where 

r j = (Ojj, , . . . a^}(f = I.... , n) are the rows of A, then there 

exists a Junction D M n (A') -+ A' streft that 

(i) D 13 linear on the rows of A, ie. far f = J, 2,,,., it 

D(ri, .a^- + f/, ■ ■ - - tj = &D{r . r H ) 

+ D(r lt . r n ) T 

(il) if two adjacent row?, of A are equal, i, e r r k - r k+ ( for some k 
such I fiat k = 1, 2 . ti — /, then D[A) = 0, 

(iii) £*(/„) - I, where I n is the identity n x n matrix. D is uniquely 
determined by the above properties (i) p (ii) and (hi ► and is called the 
determinant function. 

The reader should note that the r f arc rows of the matrix A, which has 
been written in the form A - 0 Xl ...jj for obvious typographical 
reasons. 

Before proving the theorem, we show than the additional properties, 
of determinants which have already been verified for n — 2, 3 are 
consequences of the three defining properties (i) h (ii) and (iii). 
Furthermore, we shall also denote the deCcrmmanl function by det 
and the value by det A or the more traditional |4 | or (oj depending 
on what is most convenient in the context. 

PROPOSITION 2.2 For; = L 2, ,..,n-l,if 

j0 = 0]. + 1 , r yt ..., r n ) t then det B - - det A, i, e, if two adjacent 

rows of A arc interchanged, the value of the determinant is changed by a 
factor of—f 


































PROOF 


by (ii) 


0 = det tf|,..., ry + fy+'+' r f - ■ -1 r rt \ 

= tet(r . ,r r fy - r n ) 

+ det (ri, ., , r r^ fj +J » • - - » r n ) 

+ Jet(r t .*7 + |T f ^‘ ■ ■ 

+ del (ft* - - *, r /+i* r /+i T * ■ ■ *0* 

by repeated application of(i) 

= o 4- del 4 + det 5 + 0, by (fl) t 

i hiit is 

del# = ~det A. 

PROPOSITION 23 ///wo rowj /a >1 aw fften 

= 0, 

PROOF Suppose that (he ith and /th rows of 4 are equal. Interchange 
the j'tb row with the succeeding rows adjacent to it until it is adjacent 
to the ith row. By Proposition 2.2, the sign of the determinant changes 
at every' interchange, bn! now we have a deterniLiia.pt with adjacent _ 
rows equal and by Theorem 2-1 (ii), det >1=0. ® 

PROPOSITION 2.4 //j # I. then 

det (i*!,.. * p r t + off . r f ,, *,, r rt ) - det(r^ ,r t ,... ,r n ), 

i.e, if a scalar multiple of one ww jj added to another row then the 
veiue of the determinant is unaltered. 

PROOF del (/-,. r f + ar /t ... T * ., 5 f n ) 

= det( j - ii, 

+ fit det (r tt ... , r r ,. . , /y,.... r n ) by Theorem 2.1(0 

- det (r u ..., r f .r„) by Proposition 2 3 

|p order Co prove the theorem we need the following 

DEFINITION 2,5 if A = (ft,,) e M„ (A), let A i} e M n _, (A) he the 

(>i — [ ] ;< (n — I ) matrix obtained by deleting the ith row and ;th 
column of A. A if is called the minor of the element Qt if . The eofat tor 
of a ir in A is 

c tj - (“1) J +i det Ajf GK 
EXAMPLE 
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£.*= (-1} 3 det^ 'j - -S 

ct» = (-D 5 <1«1 /j |) - -2 

We note that the sign {—Ip + l is given by the pattern 

/+ - + " .\ 

- + — +■ , , , \ 

W e are now in a position to give the 

PROOF OF THEOREM 2,1 The proof is divided into two parts. We 
First prove the existence of the junction D and then show that it is 
unique. 

EXISTENCE For a lined/ = 1, 2.rt, define D ; M n (A) - A" by 

DM) = £ % c, t 

f = t 

The proof is by endue lion on n, that is, we assume that we have been 
able to define determinants for all integers < n, 

If rt = I , then the determinant function exists, he. £>(£)*= ft, a6A‘ 

(we have also verified this for n — 2, 3), 

We now show that D satisfies the three properties (i), (ii) and {id} 
in the statement of the theorem. 

(i) Consider D as a function of the fcth row of A. and consider for 
a fixed I < i Crt, (he term 

«i,‘„ - <-n ,+ '«„ *'(yi 

If i & k, ft,-, does not depend on the A’th row and by induction, since A i{ 
contains elements from the frth row of A, det A i( depends linearly on 
the feth row of A. If i = k. a n depends linearly on the A:th row of .4 and 
det A i( dues not depend on the fcth row of A. 

Thus, each term in 0(4 ) depends Unearly on the £lh row o( 4 arid so 
also does DM), 
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(if) Suppose (wo adjacent rows of A are equal, say r k = r K+] far 
some k - 1* 2*,.., n — 1* Let j# Jt, A + L, then A i{ has two adjacent 
rows equal and by the induction hypothesis. e„ - (—If ^ - G. 

Thus, we have 

AtiA = a tjf {-“iy + *detC4^) + a JttM {H) /+i+l detCA t+M ) 

But A k{ = A a+u and so detU^)- det(4 i+l</ ) wid.^ - thin 

we have 

dfltid = = 0, 

(iii) [f 4 = I n , the only term which gives a non zero contribution in 
DU) is 

H)' +, ^,det(4) = l a«4,, » t 

by ihe induction hypothesis, i.e. 

D(4) - I 

UNIQUENESS Let D, D f ■ M n (K )-+ K satisfy the three conditions 
(0,00 and (iii), then we show that 

D(fi, r 3t = D'(r j, r t -rj 

for at] A ■ ^ 1 , .r a , . .. , rj E MJA'}. If .4 = {r u ,r n ) and 

Mru F»-“ Dfr,, r 2 , . - T r rt ) - D'(n>^.FjJ, 

then we must show that 

Africa. r H ) = 0 

It ts easily verified that 

(a) A is linear in the rows of >1, 

(b) if two rows of A are equal then A(r,, r lt . . . , r ff ) — 0, 

(c) tf Un /j s , ,, J H ) is a rearrangement of (1 t 2, . . ., n) then 

- T t) = ± Mr lt r ir .. ,rj 

(d) A(I n ) = 0. 

Now. let 

e, - (1,0.,.., O), e s = (0*1.0.O). 

- (0,0.0,1), 

then for i - 1,2. n 

ft 

*i = (%.««■.°r4> = £<*/«/ 


4 b 


Thus, we have b> repeatedly applying ia I above that 


A(r,.r a .r_) 


= A ( Z Oit'k- Z ) 

'*-1 pfc — l / 


£ Q n V- 

Mf=i 

z <h«, * ■ ■ *"*„ i ( e *,> . e *„> 

. 1 


where the sum ranges over the n n terms obtained by allowing 
fci, k %,. . . „ k n to take values between I and n. 

But, by (b), if any of the e k \ are equal, A(e k t e k , >t k ) — 0 . Thus 
it follows that 


A(r u r r ,. . . , r„) 



ft EJt, “ifc* 





where the sum ranges over all rearrangements (Al, Aj,, .. , A fl ) o f 
(] t 2 , . .. Y ri). By (c) and (d), it now follows that if (ii, Aj t . . . ( A fl ) is 
a rearrangement 01(1,2,... , n) then 


. e t ) = *A( e i.fa. e „) 

J ™ fj 

= 0 


and thus 

Tj, „. t t r^) =■ 0 as required 

Remark t By a similar argument to the above, it can be shown that 


Dj/tt '"ji — ‘ ♦ 4) — Sfl lit Q Mi . . . a rtk n ^ C *, B . e fr B - 1 

= 2 «p» (*i. *1.. <0 ft i*, ■ ■ • a „ v 

where the sum ranges over the n! rearran gem cuts (it j, k 2l . . . , of 
(1,2,. , . . h) and sgnffri. kt, . . ,, ^ n ) = (—1 ) p , where p is the number 
of row interchanges required to obtain the Identity matrix f„ from the 
matrix (e^, e^,. . , , e k This formula is often given as the dcrinition 

of the determinant of a matrix; the reader should verify this formula in 
the ca&E£ n = 2 T 3, 

Remark 2 From the definition uf D, it follows- that if a matrix A has 
a column of zeros then DM) - G. Furthermore, if A has a row of zeros, 
it can be proved chat DM \ = 0 (see Exercise 2.2, No. 9). 
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Remark 3 The uniqueness of [he determinant function implies that 
the same value for D(j 4 ) is obtained whatever value for / inch that 
J *5 ft has been used in the definition of D(-4), We caH this the 
expansion of the determinant of I in terms of thejih coin mu of A 
Similarly, for each I < i<*n 

K 

gives the expansion of the determinunt lit leons of the ith row of -I 

(see p, 56 for a proof of this). Thus, a determinant is expanded in 
terms of row or column which is must appropriate as illustrated in the 
examples below, 


EXAMPLES 


-1 

0 

0 

3 


-1 

0 o 

3 

1 

3 

4 

1 


0 

3 4 

4 

2 

2 

1 

5 


0 

2 a 

II 

0 

1 

2 

1 


0 

1 2 

7 


Using Proposition 2.4 


3 4 4 

2 1 II 

1 2 1 


Using the definition 
of determinants 


0 -2 -17 

0 -3 -3 

I 2 7 


-2 -17 

-3 -3 

= 45 


1 

X 

y 

1 


i 

X 

y 

] 

1 

X 

X 

X 


0 

0 

x—y x — 1 

X 

J 

xy 

y 


0 

1 -x 3 

0 

y—x 

X 

X 

xy 

i 


0 

X — X* 

0 

1 -x 


4& 


0 x-y jr—I 
l - * 1 0 y-x 

*“** 0 1 -x 



I-* 1 

y-x 



x — x 2 

1 -x 


-<*-.00 

-*) 

l-x 2 

V — X 

4 


X 

i 

-(x-v)fl 

-xy 

i y 



x 1 

= (X - l)(x -y}0 -xy) 


3, Let 

1 

1 

., * 1 


Jfj 

Xj 

■ ‘ 

[>„ - 

x] 

*1 

- x 2 


*T 


n-i 

’ ’ ' 'Ft 


then w? prove that 


Df] rf>i 


n & - Xf ) 

r>/>! 1 r 


The proof is by induction on rr r the result being clearly true when 
n = 2, l.c 


D, = 


*1 x 2 


= X}~X, 


If r { (r = 1 , „. . , n) denotes the /th row of D^, then carrying out 
successively the following elementary row operations 

r , ■* r * ~ f.',-,. Vl^ Vl “*1 '*-1 . r i - 't ~*i '< we ob,ain 
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I I 


* „ . 1 


d. = 


D Xj-Xi 

0 xi) 


■ ■ * n “*i 

■ - ^**“* 1 ) 


0 *"" a (** “-*i) ■ * * *?‘ 1 ft, “! Jf01 

= ft-XjJft-x,) . ■ v ft-*i) D n - l 

The proof is now completed by induction on n. D n is called the 

Vandermonde Detenu hu nt. 


4. 

Let 


D_ 


2 i 0 0 . . . 0 

1 2 I 0 * . ♦ 0 

0 1 2 1 , , * 0 


0 0 0 0..1 2 
- 2EU-EU 

Thus we have 

^fl ^rr-l — ^n-1 “Hf-a = ^ft-2 ~®n-i 

from which we infer that 

D a -D, = 3-2-1 

Similarly, we have 

0,-i“D n . 3 -1 


Dj-D, -1 
and adding gives 

D rt = (u — I) 4- Dj = n + 1 

Exercises 2.2 

I, Evaluate the determinants 

SO 


0 

™1 

2 

1 

(Li) 

2 

J 

0 

I 

--4 

3 

-3 

5 


-I 

2 

1 

0 

1 

0 

0 

-1 


1 

2 

5 

3 

“1 

1 

0 

1 


0 

-l 

1 

1 


(in) 


2 

5 

1 

3 


-1 

6 

-2 

—2 


I 

1 

1 

1 


1 

2 

I 

J 




2, For wliat values of x is the determinant 


x a b c 
a x b c 
a b x c 
a b c x 


= 0? 


3. Show that the value of the determinant 


0 111 
1 0 a + b a + c 

1 b + a 0 h + c 
I c + a c •+ A 0 


—4 (ai ■+ + riu) 


and hence hud the values of the determinant when 
(i) «,i and c are the distinct cube roots of unity. 
(Li) a, b and c arc distinct fourth roots of unity, 


4. show that the following mowed determinants 


























m 


X i l,.,! I 

I x 0 . . , 0 0 

t 1 x . . . 0 0 

i i i . . , i x 


(lii) 


Ov) 


= [x - U - I)* -3 + x n ~ l \ 


x 

1 + x 5 

X 


1 + x 2 

X 
0 

0 0 
a + b a a 
a a + b a 


0 . 

x 

I 4- jc 2 , 


0 I 
0 

0 =1 +JC 1 +_+ jc 3 


0 x ] +* 3 


= b *{w + b) 


a a T . , a + b 


S. II A — (a 1i \ is an n x n matrix with On ^ 0 and also cr p; 0 when 
i + / >ri + 1, ihe remaining elements all being zero, find an expression 
for dec A. 


b. Lei A n be the 



0 l 

0 0 
0 0 


X n matrix 

0 0 . . , 0 

4 0 . , . 0 

-2 4 . * . 0 

0 0 1-2 

0 0 , , . I 


0 

0 

0 

* 

4 

-2 


\ 

I 


Show that diet A n = 0 when n = 3ft — l and find del A n when n — 7>k. 
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1 , Let D : Af r| (R) -* R be such that 

DU) D(F) - DtAB) 

for all A , B S Af n CR). Show that either DU) = 0 for all A € Af rt (Rl or 
6>(/ q ) — 1 in the latter ease, show chat DU) ^ 0 whenever A is 
invertible. 

If n = 2, suppose further that D ^ q) ^ ^ ^ Prove the 

following 

(i) D(0) - 0. 

(ii) DU) — 0 if ,4 3 ,= 0 t 

(lii) DUf = DU) if B is obtained by interchanging the rows 

(or columns) ofj4. 

S. If A is an n x n matrix which has a row of zeros prove that 

DU) — 0 r 

9. Let A fi be the n x n matrix whose (r T ;)th element is |x — f\. Show 
that M Al = (-1 ) n ~ 1 (n-l)2 n -\ 

2 J Further Properties of Determinants 

In this section* we prove that the determinant function is multiplicative 
and deduce some important consequences of this result, The proof 
involves the notion of elementary matrices introduced in Chapter 3 „ 

We first prove the following lemma 

LEMMA 2.6 If t ii an elementary matrix, then 

(i) det £ ¥= 0 

(ii) det£* = det£" 

(lii) is an elementary matrix. 

PROOF Die proof is by a case-by-case evaluation of the d e term man i 
of the three different types of elementary matrices 

det Af f (a) = del M^a)* ~ a (f = I,.,., ii) 

Jet H if - det Hj f = —I (ij = 1, * ***n) 

detA^(a) - det Ayioif = I UJ = 1, *. * *n) 

proving ( i) and (Li S. To prove (iii), we note that 

fl? - H u a ,m' *= V 0 ' * 

We now- prove oui main theorem. 
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THEOREM 2.7 If E is an elementary matrix, then 

del £.4 = (d*t£)(det4) 
for all n :< n matrices A . 

PROOF The proof is again by a case-by-case evaluation, 

Premul lip lying a matrix A by M,(a) is equivalent to multiplying the fth 
j qw of A by at, thus 

del (&)4} = a det A by Theorem 2.1 (i) 

— (Jet. Mfia)) (dil A i by Lemma 2.6 

Pre multiplying a matrix A by II^ is equivalent lq interchanging (he rth 
and/th row of A „ which by repeated application of Proposition 2.2 
gives 

det (H i} A ) = -tei A = (det (det ,4) 

Similarly, prermiltiplyjng a matrix A by 4^(a) is equivalent to adding 
a limes the /th row of A to the fth row which by Proposition 2.4 and 
Lemma 2.6 gives 

det(4 fjf (a),4) — det A — {del. Cl^-ja ijudet ,4) 

Our main results are now obtained as corollaries to this theorem. 

COROLLARY I A matrix A is non-singular if and only if det A 0. 

PROOF If A is non-singular, then by Theorem LI 7 Corollary l, 

there exist elementary matrices^, ... , E r such thai 

E\Ei ,.. E r A = I n 

Thus, by the above theorem 

(det#i)(d«£'j). , , (det£,)(deM) = det/, = l 

and to del A ^0 as required. 

Conversely, if A is singular, then by Theorem LJ7 there exist 
elementary matrices E lf „.. ,E r such chat 

E,E 2 . r .E f A = R 

where R is a reduced echelon n k ji matrix which contains a row, and 
hence a column of zeros Thus, del/? = 0 and since by Lemma 2.6(1),- 
det Ef ^ 0 (r = 1, .. - , r), it follows that del A =0. 
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COROLLARY 2 If A and B are n x n matrices, then 
det AB = (det A ) (det Sf) 

FROOF If A and B arc non-singular matrices, then by Theorem 1.17, 
there exist elementary mat rices iT,, ..., E r *E j„. .., E' s such that 

A = E ri B = ElEl^.E; 

Then, by repealed application of Theorem 2.7, we have 

dec AB = det (IT, ... E t E \... £p 

“ (dftt Ef )... (d^t £ f )(det E[) .. * (det 

= (del4)(dftt^) 

If A is singular, then by Corollary I, dec A =0 and by Theorem 1.17 
there exist elementary matrices Ej . E r such that 

A = E x . r ,E r R 

where R contains a row of zeros. Then we have 
det iAB) = (det £])... (det £’ f )(det RB) 

“ 0 

since RB also contains a row of zeros, 

Thus again 

(det4R) = (det A) (del B) = 0 
A similar argument is used if B is singular. 

COROLLARY 3 Hie system of n homogeneous equations in rt 

n 

variables "L a ( X = 0 (r ~ I t . , „ , n} has a non-trivial solution if and 
/=* 

I 

COROLLARY 4 If A € {K), ihm 

det A * - det A 

PROOF If A is non-singular, then by Corollary 2 to Theorem 1.17 

A = E t ...E r 


only if del A** 0, when A = (ity). ^ U ..,< . ? - 7 

PROOF This follows immediately from Corollary Land Corollary ! 
to Theorem 1.17, A 
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where £ t (Y - I t .,. , r) art elementary' matrices. Then using. Ixmma 7.6 
and Theorem 2.7 we have 

d CIA* - (det (del E\) 

= (del £i)*.. (del E r ) 

— det 4 

If .4 is singular, then by Corollary I, det A =0 and 
A =£,, ♦ *E r R 

whete .,, ,£^ are elementary malricei arid R is the reduced echelon 
matrix of A . Since R f has a raw and column of zeros, ti fallows that 
det R 1 — 0 and thus, we have 

det .4' = 0 

that is, 

del4 r - del 4 (- 0) 
in this case also* 

This last corollary is important in that it shows that the defining 
proper lies of a determinant slated in terms of the tows of a matrix ,4 
ate also true for the columns at"4, Le. 

(i) del is linear in ihe columns of A 

00 if two adiacent columns of A are equal then del A = 0. 
Furthermore, Propositi on& 2.2, 2.3 and 2.4 can now also be stated for 
the columns of A and also 

n 

E nt if C () = det A (l = I..fl) 

Of course these statements could have been proved directly for columns 
only minor modifications of ihe appropriate proofs being essentia]. 

Exercises 2.3 

[. Determine which of the following matrices arc non-singular 


(0 

1 2 l 

3 \ 

(til 


1 \\ 

(ill) 

1 

0 2\ 


1 -1 

z 


7 

0 1 


-1 

1 I 


\4 5 

- 2 I 


\ 1 

3 J 


2 

-1 ij 
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2. ITS,. = Qf r +• |3' + 7 r , by expressing the determinant as the product 
of two determinants show that 


3 


ij 

S\ 

*7 

Sj 

Is 


s* 


(a--i3) 2 (a-y) i 03 — 7 )- 


Fv:i|mate the detenui riant 
3 Jj f 3 

.! 1 h S-l 

h ij 

3. If s r — + {$' + y\ show that 


*r 

f j '+1 

S ir-Z 

*r +1 

^+2 

S r~3 

J l-+Z 

f ^3 

S r+4 


= a 'i5'Y 


If or,, J?,7 are roots if r' +■ bx + c, evaluate Ihix expression in lenns of 


h and c. 

4, Prove that the product of the matrices 


/ ffi + ift, t'r + idA / f 5 + icf ? \ 

tf t — ibj l- (C t - id)) flj-ita/ 


is another matrix of the same form, where a lr h ,, c t ,d } , a t . b^c 1 .d 1 
are integers. By evaluating the determinants of these matrices prove 
that the product of j sum of squares of four integers with a sum of 
squares of tout integers is. the sum uf squares of four integers. 

5 r Lei .4 he the matrix 

( a + 6x + cx* a + by + cy 1 a + bz + c£ 2 \ 

c + ax + bx 1 c + ay + by 1 c +az 4- bz l I 

h 4- cx + ax J b + cy + ay 1 b +■ cz + az z 1 

and let B he the matrix 
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Find a matrix C such that A = CB. 

Show that Ihe determinant of A is equal to 

a + P +£ 3 4- b +c 3 + b +c 

ax + cy + ftz frx + fly + cj ex + by 4 az 

ax 2 4- cy 3 + 6z‘ bx i + fly 1 + cz 3 ex 1 + fry 2 + flr a 

6, Determine whether the following systems of homogeneous equations 
have non-lrivLaS solutions 

(i) x 4- 2y — t = 0 (ii) x + 2y — i = 0 
-2x + y + 2r = 0 -2x + y + 2z = 0 

x — y + r = 0 x - y — a = 0 

7, Show that if k '-4 1 there is always a solution to the equations 

2 x — y — z = fi 
x - 2y + 2 *■ p 
x + Ay — 22 = p 1 

whatever the values of p and for a fixed p ihe solution it unique. Find 
the solution when k = l.p = I, Show that if k — 1 there are exactly 
two values, of p for which the equations have solutions; find these 
values and salve the equations completely In each case. 

8, For which values of k does the foil owing system of linear equations 
have (i) no solution, (ii) a unique solution and (ill) more than one 
solution? 

x + (k + 2}y + 22-2 

(Jt a + 1)x + 2(A + 2)y + 4z = 4k 

3* + 9y + 3(A + 1)* = 6fc 
9 r Solve Exercises 1.3, Nos. 3-7, with the methods now available. 

2.4 The Inverse of a Matrix 

In Chapter I, a method was presented for inverting a matrix. We now 
give an alternative method Which h not as efficient far practical 
purposes but is. more useful theoretically. 

By the definition of determinants,, we have for / = 1,2>,,., n 


5S 


n 

2 Off Cjj = det>l 
i=i 1 1 

Furthermore, for k we have 



a,i . 

- *i) . . 

i Ot\j * * 


I «t t c rt = 

i-i * 

- 

-»■ 

’ ft a; * - 

■V 

*3-i 

* 


* 

■ *Af ■ . 

* <v * ■ 

Q Ftn 


= 0 


Combining these two, we obtain 


*■ < 


| ■%«» = «/* L.Ur* i A = 

DEFINITION 2.8 1/^4 -= A/„ (If) i hen the adjoin t of A, denoted by 
ad] A is defined by 

adjA = [c,/ 

i. e. the n x n matrix obtained by placing in the {/, jyposition 

Then, using {l), we have 

(adj A) A = (ty)Kji) 


| ^ a i/ 

'det A , , . 


0 V 


0 ... det Aj 

= (det A)J n 
Thus, if det A *0, then 

^A A=l 

det A 

or in other words, since (lie inverse of a tnalrix is unique, 
3 adj A 


A~' = 


det .4 


0) 
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EXAMPLE belA — 


0 -i\ 

I -] I, then del A = 4 and 


adj A — 


There fow 


. 

l 

—l j 


0 

’1 

_I_ 

0 

-1 

-r 

2 

5 


2 

5 

T 

l 

“I 


2 

-1 

+ 

1 

-1 


1 

-1 


1 

5 


1 

$ 


2 

-1 


2 

1 


1 

0 


I 

0 

\ + 

1 

2 


1 

2 

* 

2 

C 


7 

—2 

l 1 ' 






-n 

6 

-1 






\ 

3 

-2 








A 1 = J 


As mentioned earlier, thts is not an efficient method for calculating 
the inverse for targe n, it involves the evaluation of one n x n determi¬ 
nant and n 2 (/i — l)x (n — I) determinants. 

This may be applied to the solution of linear equations. Consider 
ihc n linear equations, in n variables 


Z * P - 0 f . 


0=1 


► n) 


or in matrix notation 
AX = b 

where 

A = C^-), X* = (*,,. - . . #J, b* = 0*1- * ■ ■ fij 
If .4 is invertible, then 

X = A h b = b 
* det A ° 


or for i = 1,2,,. . ,R 


*< - *b 

det At 

det A 
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where ,4 r - is Hie matrix obtained from A by replacing its rth column 
with the column fr, i.e. 


/a, 


Ai = 


i 

ii ;i 


V 


— * *W 

Tins ls the well known Cranier-solution of linear equations 

i 

EXAMPLE 


X —2 = 1 

2*+ y— z = 1 
* + 2>' + Si = 2 

i sine the inverse of the matrix A obtained in the above example we have 



or alternatively, Crimer's solution gives 




= i 



0 

1 

2 





Exercises 2.4 

I. Use the methods of this section to find the Inverses of the following 


matrices 


(n 




(a) n —i i\ 

\5 ~2 1 / 
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(ill) /I 


t 


3 

5 


































2 . Use Cramer’s method to solve the following systems of linear 
equations 

(i) x — y + 2z - 1 (ii) 2* + 3/ — 5i — 4 

lx + y + t = 2 x + ly — 2z — 1 

j“3>'+ z = I Sjt w 1 ly + 2z = -2 

3. For what values of i wilt the following, matrix be noil-invertible^ 
For all other values of t, what is the inverse? 



4. If A is an n x rj matrix, prove that 

dct (adj A) = (det^')"” 1 

5, Find the adjoint of A t where 



If 


/! 0 0 

B = 1 0 I 0 

\l 1 jt - 


for what complex values of jt is the 


product of adj A and H non-invertlblc’ 7 
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CHAPTER 3 


Vector Spaces 


In this and the remaining chapters the following notation will be used: 

A" is an arbitrary field 
R is the field of real numbers 
C is the field of complex numbers 
Q is the field of rational numbers. 

3,1 Introduction 

In physical connections, a vector is usually defined to be a “physical 
quantity which has magnitude and direction/' As the work of this 
chapter involves a generalization of a vector , we first attempt to define 
more precisely a vector in the plane and in space, 

We shall first consider the case of a plane. By a point in the plane we 
mean an ordered pair (a.b) of real numbers li e, each point is jep^ 
resented by coordinates a and h relative to a rectangular coordinate 
system! The origin Q is rhe point (0,0). A directed line segment from 
the point P to the point Q , denoted by Pf2, is a line with initial point P 
and end point Q. that is. a directed line segment is an ordered pair of 
points (see Figure I}, 

I IT - (Pi,p 2 ),Q- = {^i. f j)jT = (Jj, ij) are four points 

in ihe plane, the rwo directed line segments PQ and RS are said to be 
equivalent if 

(fli-Pufla-ftJ " (*!” ft-^a) 

This relation is an equivalence relation on the sec of all directed line 
segments in the plane, for it is clearly TCtlexive and symmetric and if 
also J?5 is equivalent to TU, where T - (f|, fj), U= (xi,, irj} are two 
further points in the plane, then 

(tfi— = (u : -t u Ui~t x ) 
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and the relation is also transitive, Now, it is easily seen that every 
directed line segment is equivalent to a unique directed line segment^ 
with initial point jthe originif P = 0 c then ?Q 

is equivalent tu OR. where R - [q k — Pj.tfj — Pih Thus, each equivalence 
dais of directed Line segments can be representedjjy a directed line 
segment with initial point the origin O. A vector OF in the plane is 
defined to be the directed line segment with initial point O and end 
point P. A vector is completely determined by the co-ordinates of its 
end point, thus a vector OF will be denoted by ip t .p%) r the co-ordinates 
of the poinL F. Let (Rf denote the set of all vectors in the plane, Le. 

Fj(Rj = 

There is a well known rule, called the parallelogram rule, for adding 
vectors. If OF and OQ are vectors, a vector OR Corresponds to the^ - 
two vectors in the following way: 
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y 



Ft <Ji 

Figure 2 


RiPi4 qi 


■ Pi+Qj! 


Sjip lr 


Let QR be the directed line segment with initial point Q which is 
equivalent, to OP (i.e. QR is parallel to OF and withjhe same length 
andFF is^the directed line segment equivalent to OQ). Then OR is the 
sum of OP and OQ t i.e. 


OP + OQ = OR 

Of 

CPx.Pi) + C?i.fla) = (Fi+ffuFt+fla) (1) 

The multiplication of a vector OP by a real number \ can be dealt with 
similarly, X OP is the vector OS of length IX | OF in the same direction as 
OP if X is positive and in the opposite direction if X is negative, this gives 


XCPuPi) =* ^FipXPa) 


( 2 ) 


Thus, on Vyi Ri addition is defined by the rule (I) and scalar multipli¬ 
cation by elements of R by (2|. 

Directed line segments anti vectors in space for 3-space) can be 
defined similarly. If we let Kj(R) denote the set of flh vectors in space, 
or 


IS(R) - <ta.M)l«,0.TeR} 
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then similar geometric conditions will give the rule for addition in 
F 3 i;R) and scalar multiplication of elements of Fj(R) by scalars in R, 
namely 

(a, 0 t 7 ) +(a f r j3 r , 7 ) = (a +ft'.jJ + /J',7 + t') 

and 

U%P.y) - 

With the pattern now developing, we can proceed to define V n 1 R) 
for n > 4, except that for these higher values of n we do not have a 
geometrical interpretation of our "vectors 11 . We shall sec in later sect Eons 
of this chapter and book that the generalization proves to he a useful 
one. Indeed, rather than restricting ourselves to the real numbers only, 
we can work aver any field K, So we give the following 

D EF1NTTI ON 3.1 If K is an artItrary field, let 

V„{K) ^ {(a!, fij,..., a 4 ) I Qt e A' (f= 

Define addition of elements in V H {K \ by setting 

(a lT ftj, ♦ *. „ aj + (fi u , 4., “ (ai+ ft, <*1 + &»►♦*, <*„ +J 3 fl ) 

and scalar multiplication of elements of V ri (A) by elements of K by 

ct(a^, Qj,..., a n ) = (03!. aoj,..., ao^) 

for all a, a / > Jfy (f - 1 p .., , fl) E A'. 

Having given these deFmilions. we can show that addition and scalar 
muitiplicatton satisfy many rules which allow us tu manipulate these 
vectors according to the usual laws of algebrii, These are expressed in 
the following theorem, 

THEOREM 3.2 Ifu aj, v - (ft, . ■ ■ . 0 B ), w - ( 7 ,,, .. . yj 

are arbitral dements of V n tk) and tit, (i are arbitrary dements of K then 
(i) u + v e VJK) 

(it) u + (® + w) — (u + p) + w 
(lit) u + ** v + u 

(iv) there exists aO€ V n (AT) such that u + 0 = u for ait u E V n (Af) 

(v) for each u = fa a , . . , <= V n (AT) there exists a 

—u = f—Q|, + ,. t — a ff ) £ V n (AT) such that 11 +■ (—u) - 0 

(vi) WIEV^K) 

(vii) (a 4 d) u = an + $u 
(vili) a(u + v)- mi 4 op 
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fix) a(i$u) = (ajj)u 
(x) 1 U = U. 

PROOF The proof is elementary, we shall prove some parts, the 
reader should verify the remainder, for example 

u + (® + w) = {* 1 , {{ft-- ft) 4 (j ly .... y n )) 

= ( a h ■♦«,«„) 4 (ft 4 Tfi. *. .. ft, + 7„) 

= (a, + (ft 4- 7,) ( -ft + (ft 4 yj) 

= ({ft 4 ft) + y,.(ft 4 ft) 4 ft) 

™ (W 4 t?) 4 W 

which proves |ii), The 0 £ V n (A r ) required in (iv) is the n-tuple 
0 — (0, 0,. . , r 0l and in (v) 

(*u ■ ■ +(-q 3! ,*h*-c»J= f*t +(-0,) f ,.. .a/l-aj) 

= (0 . 0 ) - 0 | 

We shall not develop further our study of V H (ft) at this stage. Indeed 
just as FjlR) and (R) were used to motivate the definition of l' n {K) 
for arbiirary n and arbitrary fields A J , we shall use (iHx) in Theorem 3.2 
to motivate (he definition of a general abstract structure, called a vector 
space of which ! r n (AQ is merely an example, albert a very important 
and typical example as will he seen before the end of this chapter. 


3.2 Definition and Examples of Vector Spaces 

DEFINITION 3,3 A set \ ej allied a rector space wet the field K or 
a K-space if 

(a) (i) V is i closed with respect to a binary operation called 
addition (+), Le. ifu. V, then u + P€ V, 

(ii) (commutative axiom) u + v = v+ u for all u, vE V, 

(lii) axiom) u + (y + w f ) = (u + v) + w for all 

u, u; w € V. 

(iv) there exists an dement 0 F V, called the zero dement, nidi 
that u + 0 = 04«=ij for ad u E V 

(v) for every uE l \ there exists an dement (— u| E V such that 
v + (—it) - 0 - (-"y> 4 V f 
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(b) fj) for every aEK, Van demem av called the scalar 
multiple of v by a, is defined and a v € V. 


(ii) a(u 4 y) = an + or?, 

(iii) (a 4- fj) v — ort 1 4 dv, 

(iv) a(fto) = <a0)n 

(v) \ v — v. 


farallaEK, u r vG V\ 
foraU^&GK, vEV, 
foralla^EK, vE V. 
for all v€ V, 


EXAMPLES 


1- V»(K)= 

was shown to be a A-spact in the previous section. 

2. Let P{K) be (He set of a|] polynomials in an indeterminate x with 
coefficients from A', i,e, 

Pi_K) = («*+*,* + .. . + a m x m te m *Q,a j EK(t~t . t m )I 

4- is the usual addition ot" polynomials and if a€ A. then scalar multipli¬ 
cation by a. is defined by 

a (ag 4 a i x 4 L . „ 4 jf") - ouio 4 «a j X + . . , 4 x M 

Then /"(A") is a A-space. To verify this all the axioms in definition 3.3 
must be shown to be satisfied. In general, the verification is elementary, 
as in for example, 3.2 (a)(il) H if/fc} = etg, + 4 ,, + and 

*(*) = A, + j3 l jr + . + &„x n t assuming, without loss of generality, 

that m> n, then g(x) = A) + Pi* + . -. + x* 4 .,. 4 $ m x m . where 

A.+i~ **■**■ = *>■ Th ™ 

fix) 4 g(3 r) = (0*4 do) 4 (a, 4 0,)* + . . . 4 4 $ m )x m 

- Cfti 4 + (Pi 4 a,)* 4 ,.. + (§ m 4 ajx m 

“ ,f U) + A* ) 

3 , Let P n (AT) he the set of polynomials of degree < n with coefficients 
in A , i.e. 


e„( AT) = la, + a,jc + ... + «„ *"la, 6 A' ((= 1.n)} 

If addition (4 J and scalar multiplication by elements of A" are defined as 
in Example 2, an elementary verification again shows that P^ (A) is a 
A-spice. 


4, Let X he an arbitrary set and A" an arbitrary field. Let 

K x ={fiX-+K) 

be the sei of all mappings (functions) of X into A. If f g € K x , a G A, 
then addition and scalar multiplications are defined on A* by 

O' 4 *) (*) = /1» + g(Jf) for all X e X 

(g/ 1 ) (jt) = a/(x) for all x G X 

Then, it cm be easily verified that A A is a A-space. 

Some important special cases are given in the iicxl example. 

5, (i) If X - A - R, then R* is the R-space of real valued functions 
defined on R. 

(.ii) If X is the closed interval [e,A J = (r€R I *r < or < 61 where a,b 
are any real ntimbers and A = R, ilicn R^- 6 ! is the R-space of real 
valued functions defined on the dosed interval [e 4 &]. 

(Iii) If X - N = {0,1,2_} and A * R then is the R-space of all 

sequences } (sec Exercise 3.3, No. 6). 

6, C is an R-space since C = a t /J£ R} = V t (R). 

7, Every field K Is a A-space, Scalar multiplication of elements of A by 
elements of A is simply “ordinary" multiplication in A Thus all the 
axioms for a A^-space are covered by the defining axioms of a field, 

in particular C is a C-space, Examples 6 and 7 show that the same set 
may be regarded as a vector space over more than one field. 

8, Let r] (A r ) be the set of all m x #i matrices over A. Addition of 
matrices and scalar multiplication of matrices by elements of A have 
been defined in Chapter I. § 1.4. where most of the axioms for vectot 
spaces were verified. The remaining axioms are easily verified and 
M m ^(A^ is a A"-spice. M H (K) denotes the vector space of all n x n 
matrices over A. 

The examples of vector spaces given above have come from various 
branches of mathematics, geometry, algebra, analysis and differential 
equations, The theory of vector spaces is therefore potentially of 
significance in the whole of mathematics. The notation V n (A), /’(Ah 
P n (A), A* T R Mlfor these vector spaces will Ire 
standard for the remainder of this hook. 

We now prove some elementary consequences of the definition of a 
vector space. 
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THEOREM 3 A Let V be a K-spoce. Then 

(a) the zero element 0 £ V defined in J. 3{a ) (rV) is unique 

(b) ;/f6 V, then (“P) defined in i.J(a) !>') is unique 

(c) if u, y, w E V and u + if = u + w then v — w 

(d) if it, v £ V then u 4- x = if has a unique solution v — u in V 

(e ) — (—i?) =- v for ad v 

(f) O.f = 0 for all v£ V 

(g) — (aif) = (— a) v — tt(—y) ami \ — a) (—v) — ay for ail a £ AT, v £ K 
PROOF (a) Lei Q J aiso be a u io clcrtienl, then 

v + 0' = v = 0 r + v for all pe V 
Thus, in particular 

0 = o +0 r = O' + O = □' 

since p + 0 = v for all peF„f.e. 0 = 0' 

(h) Let v' also be an additive inverse of p, Le, 

p + if = j/+p = □ 

and t + (—p) = (—p) + v - 0 

Then p' = p' + O - y J + (v + (-—»)) = (p'+p) + (-p) 

— 0 +• (— v) = — v 

(c) Ifu ■+ v — u +■ w then 

(-«) + (u + p) = (-U) + (u + w) 
he, ((- u) + u) - ((—ui 4- u} + w 
i.e. 0 + v = 0 + w i.e. v = tv 

(d) Since u 4- ((— u) + p) = (u + (—n)) -+ v — 0 + v= v, u + x = v 
has at (east one solution. This solution is unique, for if X utu! X are 
solutions then, u + x = u + x' and by (c) x — x\ This unique solution is 
denoted by v — u. 

(e) If V t we have I.—y) + {—{—p» = o = (—c) + u, which by (c) 

implies —(—v) = v. 

(f) If v£ V. then O.p = (0 + 0), p =■ 0.P + 0 . v t but 0 , p = 0 + 0. v 
and by (a)0*» CLf, 

(g) ff a € Jt, p £ F then (df) + i —(a uj) = 0 and P + (—(»)) = 0 
implies au+ n(-v) = *.0 = 0 and by (b) <r(—p) = - tar). Also, 

a + (~tt) - 0 and so (a 4* (-ai).p- 0.p= 0 by (f). Thus 

aP+ (— q)p = 0 = + (-(ftp)) and io |— «)£p) = —{avf Finally, _ 

(“a) (-t?) = Q(-(-v)) = op by (e), I 
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Note The reader should determine exactly which of the defining 
axioms for a vector space are used in the various parts of the above 
proof. 

3,3 Subspaces 
Let V be a AT'Spaee, 

DEFINITION' 3,5 A non-empty subset IV of V is called a substrate of 
V if W is itself a K-space with the same definition of addition and scalar 
multiplication as in V. 

By Inspecting the defining axioms for a vector space, we note that 
some of the axioms arc automatically true in h' if [Vis a subset of V, 
i.c, 3.3 (a}(ii), (iii) and (b)(ii). (iii). (iv) and (v) r Therefore, to verify 
thai a subset W of V is a subspace we need only show that 

(i) if u, fH W then n + re w 

(ii) Celt' 

(iii) for each pG W, -p€ W 

(iv) if uG K, pG iv then ape lv r 
In fact, we can prove 

LEMMA 3.6 .4 non-empty subset It of V is a sob space of V if and 

only if oat + V t 1 W for ail a £ K. u, V S IV. 

PROOF If Vis a subspace of V, then by definition, if a E A r , u, p£ W, 
then rnr £ ^'and au + t?£ W. Conversely, since Vis non-empty, there 
exists an element u ^ IV and thus (—I) u + ti = —u + u - 0 £ W and 
hence if o G A', rf- V a.V + Q = qp€ Vand in particular —L .v — — yG W 
finally, if u, p€ V, lu + p= n + pG W. Thai is CiH) above have been * 
verified, and V is, a subspact of V, 

EXAMPLES 

1. Every vector space V has two subspaces, namely V and 10), Every 
other subspace is called a proper subspace. 

2. Let ... K (i “3. . .. t n)} C V^.thtnW 

is a subspace of V n (K), since 

(i) W is non-empty, for example (0. - -. p 0)e W 

(ii) if a G K, u ~ (0, cs 2 . aj, v - (0,0 a ,.e W, then 

au +■ v = (0, ofti + 02 ,..., + 0 n ) e IV. 

Let W = {f 1 + fti^ ora,.<*„)!&,■ ^K(i- 2,..,, fl)} £ V n (A") r 

since, for example, (2, 1,0*. . . , 0) G W but 2(2, 1,0.0) = 

(4, 2, 0,,.,, 0)? W< If is not a subspace of l^(Ai). 
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3. Let(A'} = {A EM n (A")i A l =A) C M n (A), then A/^ i} |A) is a 
subspace of M n {K) since 0 E Af^fA) and if a e K, A , J G A^ a) (Jf) then 

(ad 4- BY = aA'+S 1 = aA + B 

i.c. a A + B 

4. Let V be the jet of solutions of the system of m Linear homogeneous 

n 

equations in n variables 1 d*. i, => 0{l = I,,.. * m), or AX = 0. where 
/=J 

^ - (jf , . , , *„)*. Then F is a subspace of V n (A ), called the 

solution space of the system, i.e. 0 G P and if a £ K. X, Y E V then 

A{t*X+ Y) - aAX + AY 

= 0 

and aX + Y £ V This solution space will be considered later when the 
vector space theory to be developed will be applied to linear equations. 
Indeed, rbc problem of determining the solution of a system of linear 
homogeneous equations may be rephrased as The determination of the 
solution space of the system. 

5. Let Cf/j,h] he tile sui of real valued continuous functions defined on 
the closed interval [a.b ], Jien C[tf,63 is it subspree of RMl. in fact, 

it J\g E C[a t b J , a E R, then of + g E C[a,b ]. This follows from 
theorems in elementary calculus, which prove that if/and g are 
continuous functions then of + g are continuous (see for example 
A.S.'T. i ne, Basic Pure Mathematics [I t VNR Mew Mathematics 
Library 5, p.51). 

Lei C {a,61 be the set of all continuously differential functions 
defined on a closed Interval Jfl.A], E,e, the set of all functions which 
possess a continuous derivative on every point in [a.b ], then again 
theorems in elementary calculus show that f7> f 6] & a jubspace of 
Rftf.A \\ 4 i^ e question arises whether C'fff.fe] and C{a,fi] arc the same 
spaces; in fact. C'[a,b\ C Cfab]. as a differentiable function is 
continuous. The inclusion is strict; since, for Example, the function 
/(*) = 1*1 is continuous but has no derivative at x = 0. Sometimes, we 
are required to deal with functions which may he differentiated a 
nLimber of times; we therefore denote by C ir f a,b\ the sei of all n 
(titles continuously differenliable functions on fa, b] and by f“fff.b] 
the sci which may be differentiated an> number of times. Again, 
ii may be verified that C fi [a,b] ) and C“fa.b] are R-spaccs (ie. 

they are subspaces of i I) and that if C m |a,A] is a subspace 
of C N [ff,i»J We shall add and f to the list of 


standard notation lor vector spaces given on p,69. In addition 
aRL C fl fRh C/“fR) Will be used when [a t b] = R, 

6. let r be the subset of C 7 [a.bj which arc solutions of [he fixed 
homogeneous linear differential equation* 


d/v 

dx* 




where aU}Mx)EC[e,b]. \Tj\gE ^ a e R then 

£= m rX*> + rtx) A a+^l + AfcXftsX*) 


~ + ffU) ~ fix) + b(x\f(x )J 

+ li? g<x! +a(x} £ ^- T} + bix ^ x )) 


- o 

where again some theorems in elementary calculus have been used (be 
i is p,57) r Thus / + g G I and similarly or/ E Land V is a subspace of 
[dfb \. F- Is a soiutioH space ol the above differential Equations, which 
is an important example of vector spaces. Sometimes additional 
"boundary conditions” must be satisfied, for example, if fj <C 2 lO,ir] 
is the solution space of the differential equation 


with boundary conditions y(Q)— 0 + y(rrj - 0, Then it is easily verified 
that U is a subs pace of C a JO,*]. 

We now consider ways of constructing some important subspaces of 
a vector space. If U and ^ arc subspaces of V, then the intersection of 
U and W, U<1 to is also subspace 1 for 0 6 UH &■' and if a 6 A. 
u, uG f/fb W then it, VE. U and n, ire to and au 4- vE f/and 
etti + vE to, which implies that an + ire £/n W. Bui, in general the 
union of L and tv, (J u h J is not a subspace of V, for example, 

1‘ — Ha, 0) j a A ) and to ■— {(0, &} 1 G A."} are both subspaces of 

bul for exztnpk ( 1,0) + (0,1) = (1. 1) $ UU TK The position 
is rescued by the definition of the sum of two subspaces, Le. 

// + to = {u + w | W £ i/ t w e (V}, which is easily shown to be a subspace 


n 









nf V In fact, this can be extended to cover the sum of more than two 
subspaces. 

DEFINITION 3.7 Let W t , W Jm „,. , W k be subspaces of a vector 
space V over K, Define 

k f = + * < „ + W k = fwi + wj + ... + W t 

a = i. 

then W is coiled the sum of the subspaces W t ,.,. , W^. 

Then we can prove by using Lemma 3 6, 

LEMMA 3,8 (i) IVj n Wj n *.. ft m is a suhspace af V 

( Li) W^j + H/j +... + W k is a sttbspace of K 

PROOF (i) Since Oe W f (i= | t . ( , ( ft) 1 0G b\ n ty 7 ft ... n W k 
and so it is non-empty, rf a e K, u, W t ft W % n.,, rt W k > then 
u , v GW ( {i= 1, r ,„, k) and au + t»E W f (i ■ 1,, *., k) and 
an + v e W, n W 2 n. r , n 

00 0 - 0 + ,.. + Oe W t + Wj + ... + W k since 0 £ W t (f = I,... 
Further, if m e K, u, v e W, + W 7 + „.. + W kT then u — u , + .,. + u k , 
V = V\ + r , . + v k , where u f + v { £ (jf l „ . . . , kf Thus., 
au { + v f E W i (i = 1, „, , , A) and it foilows that 

au + it — a(U| +■ + ,. + Uj^) + (v, + ... + ^) 

= (ai/i + + ... + ( <tu k + v k f 

that is. atr + Wj 4-... + 

Now* let S = i tr [r . „ . , be a finite subset of a vector space V. Let 
U = | I ft,- v f Ift ; E A'|, Then, we can prove 

LEM M A 3.9 U is a su bspace of V. 

PROOF 0 e If since 0 = Q.v t + .. . +G.w fc £ V, 

k k 

If cr E K, u, U then u - S a ( V l and V — 2 |3 ( V s for some 

{= I i = l 

a,. J3 f E K (i = 1,. ., T k% Then 

otu + V = ft ^ 2 + ( I &i 




I 


= I («, + H)n€t' 

arid so, by Lemma 3.6, L' is a subspace of V 
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DEFINITION 3,10 ifS = (t,,,.. , v k $ Q V M then £ &. ^ , where 

A’ u called a K-linear combination of S. The subspace U constructed 
above is called the subspac? generated {orspanned) by the subset S, We 

shall denote this by U={S}ot (v t _ v k lA subspace U of V which is 

generated by a finite subset of V rv ceiled a finitely generated subspace 
of V. flies e ideas will be j Dust rated by examples to be considered in the 
next section. 

(Definition 3.10 can be extended to cover infinite subsets, If S’ is a 
subset of V, lei (I = { £ ft 
bes 

finite number of the a T are equal to tero. Then U is a sub space of V 
and is the subspace generated by 5). 

Exercises 3J 

1- Which of (he following subsets of (n > 3) are vector spaces'’ 

(i.) (fftiiftii ■ ■ ■ >0„)Jfti + aa - 0} 

(ii) {(fti, fti, . .. P Q n ) [ a, + ftj + Qj - I } 

(ill) {(fti, ft*.a^) I or 3 = ftjftg} 

(iv) {(ft Jf u lt * t . H aji I ft, | > 0} 

(v) txj J ft, - n 3 = ft 2 - 

2- Which of the following subsets of R R are R-spaces' 1 

(i) The set of ali real polynomials of degree exactly rt 

(U) The set of at! teal polynomials of degree c n 
(iti) The set of all odd functions ( i.e. f(—x) = —f{x) for all x E Ri 
(tv) Tiie set of ail differentiable functions. 

3. Which of the following subsets of C[0 T 11 are R-spaces7 

(t) ifec[Q t i)\m) = o} 

(ii> trecfluiijdtn = i) 

{m} f/eC[0,lll/{0) = /(!>} 

(iv) J/ecf0JH/ 0 , /-(f)df - o) 

(V) {/cc(0jj|^/(f)dr - u 

4. Which of the foil owing subsets are subspaces of Afj(R)? 

CO 

m 

(m 



L j| ctj E Al, where in each sum. a|] but a 
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(iv) M^fRHdeM =0} 
fvj U eA/,(R)ittetd = 1} 

<vi) {X S M 7 (R) \AB= BA for a fixed B e M»(R)} 
ivh) {XeJ#s(R)M* = XK 

5. Which of the following subsets are subs pacts of Mj(R) 

(1) (xeWj{R)ldeiX-0} 

(ii) {xgjw 3 (R31 ji^oJ 

(lii) 

6. Let K be the set of all sequences la n j - (o^oq,.,., ft flT ...) of 
elements ol R, Define addition of sequences by 

w + ffy = <«„ + <y 

ami scalar multi plica Lion by 

M<M = { Qa J 

Prove that F r ss a vector space over R. 

7. Prove Lhat the following, are vector spaces over R 

(i) {(«„) K +1 -^ = a B+3 “«i, + |.">0*««€*}* 

i.e. the sei of all arithmetical progressions. 

(it) {{«„ }iI^ +1 - + a,,,>o T «*e R K 

i.e. the set of all Fibonacci sequences. 

(lii) the set of ail convergent sequences 
i.e. {{ft }| for each € >0 there exists an integer ,\ r such that | — crl<Cf 

for ti >N for some ft}, 

(iv) the set of all Cauchy sequences 
{{ftjl for each e >0 there exists an integer JVsuch that. |ft^ — oj < e 
for tn, n ~> N\. 

3.4 Unear Independence, Basis and Dimension 
Let V he a A'-space, 

DEFINITION 3.11 A subset {P ls _} in V is linearly dependent 

over K if there exisr a t ,... , a* e K [not oft zero) such that 

fti + cti t?i + ... + ft t — 0 

If not r {^,..,,1^1(1 tineariy independent over K r or in other words, 
iftk j p l + ftjpj + r ,, -f = 0 implies that o i = 0(i = /, . ,, t k), 
then .1?*} is iinearfy independent over K. 
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EXAMPLES 

M0 t 0,1) (1,-1 P l) <1*-1,2) (0,0,1)} 

is linearly dependent over R since 

0.0,1) + (K -1, 1) — (2, —Lp 2) + 0 (0, 0,1) = (0,0,0) 

but ((l, 0, I), (0, 0, 1)} i= V 3 (Rj is linear]y independent over R, 

for if ft (1,0, !) + (f (0, 0 T 1) = (0,0,0), 

then a = O.ft +J3 = 0, or a = 0...JJ = 0 

2. We have seen in examples 5 and 6 in §3,2 that C is an R^space and a 
C'Space, 

I + i and t are tineariy dependent over C, he, 1(1 + i) + (-] + i)i = 0, 
hut linearly independent over R t for if a{ L + i) + 0j = 0 t a,,jSe R, then 
ft = 0 and Q -J-^ = 0orci —j3 — 0. 

(Definition 3,] I car also be extended to cover infinite subsets, a subset 
S £ V is linearly independent over K if every finite subset of J is 
linearly independent ovei K, otherwise S is linearly dependent over A'). 

DEF1N11 [GW 3.12 A subset S £ V is a Kdrasis for V if 
(i) S generates V 

■f is) S is linearly independent over A', 

If S = {tf,.u*} is a finite set, this means that if t€ V then 

* Jt 

v= Z a, v t , where a f £K(i- 1.fr) and if L v. = 0, 

i 1 -! /=1 

E K (i— ] t -p fr) then * G (/ = ],,,,, fr). 

We shall concentrate on this case, that is, finitely generated A'-spaces. 
Before illustrating these ideas with examples, we give a useful 
determinants!! criterion for the n columns of a square matrix to be 
linearly independent. We prove 

T FTEO REM 3,3 3 if A = [o {f ) e ^ (Jt) and c f - (a ift * + . , n n/ ) 
(j= 4 2 t r + tt n)are the rt columns of A then fe lr e 2 ,,, , , c \ is 
ii nearly dependent over K if and only if det A = 0, 

PROOF If fc|p €j,. t T t c n } is linearly dependent over K, then there 
exist ftj,fltj,. ,., ft n G A (not all 7 .ero) such that 

«t ci + 03 c 3 + ... + c n - 0 

Without loss of generality we assume that a, ^0 then 

ft-J ft nt+ 

C| + c% + ■ ' ' + ir c>i = ^ 0Ws subtracting times the second 
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column + + ^ times the rrih column from the first column gives a 

Qi 

matrix with first column iero, Thus by Remark 2 in §2-1, det A = 0. 

If det ^4 = 0, then by Corollary 3 to theorem 2.7, the system of 
linear equations 

2 % x f 33 0 0 = 1 + 2*..., n) 

7=1 

has a nontrivial solution (Xn-Xj,, . . „ Jf n ), that is, there exist 
x lr x i, „, . , £ A" (not all zero) such that 

x l c i +x t c z + .* ■ + **r PI = o 

which shows that (e,, c 3 , . , . , c n } is linearly dependent over K. 

By considering the transpose A 1 of A , we obtain 

CO ROLL AR Y The n rows of a matrix A € M rt (K) ate twenty 
dependent over K if and only if del A — 0. 

EXAMPLES 

1. Lett, = (1,0, 0J, ej =(0, 1,0), e 3 =(0,0, t > then {e Ll e^&a} is an 
R-basis for the R-space r 3 (R), since 

(1) if v = (a 1 , Oa, a 3 )is an arbitrary element in T-'j(R), then 

(ai „ a 2 > ttj) - ct, (1,0. 0) + ftl (0, 1,0) + ajfO, O, I) 

that is ^e| , 65,83 ) generates V 3 (R), 

(ii) if a L C\ + + «a^j “ 0 , then (otj, Qj, a.%) = ( 0 h 0 , 0 ), or 

a, = & 3 = ftj = 0. that is { c, , e 2 , Cj} is linearly independent over R, 

Let u, = (1.0 h l).Pi=(2 P -l T i.Uh ^(4 P 1,1). then t^rj) is 
also an R-basis for L 3 i.R). Tl can easily be verified that 

(a,, <* 3 , a ? ) = & { (~2a l + 2 a™ + 6 %) tr, + fa t - Tor, - a 3 ') p 3 
* f*i + «i 

Uia t is, f 17,, f*a ± Vf) gene rates V 3 (R). Also, {t?,, w,, v >} ss li n early 
independent over R, for if 

OtlVi + « 3 I% + Ol j t?j = 0 

where a, .a 3 ,a 3 C R, then 

a,(U 0* l) + *i(2. —1, l)+* 3 {4, 1.1) -(0,0,0) 
or oil + +4a 3 = 0 

—flr 3 +a 3 = 0 
a, +«i +a 3 = 0 
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/' 2 *\ 

Since Jet 0 -J 1 =4 f 0. the trivia] solution a, -os = a 3 =0 

U 11 / 

is tire unique solution of this system (see Theorem 3,13). 

I Ids example show's that gji R-basis for a vector space is not unique, 

2. Let Ci = {1,0...., 0), e 2 =(0, i, 0,., . T 0). 

e n “ Oh * “ ■ 1 ) e (A'). 11 (a x , a? t w ,, a ([ ) is an arbitrary clement 
in 1 r rr (A'), then 

(*u .. *. aj = I a* e, 

that is 


{«is- e „} generates F (AT) 

If 2 flj ^-0 then<a lt .... oJ = (0.. + + ,0). or 


j=i 


a, = 0(i — i,.. ^ T «>, that is, (e,,„. +, is linearly independent over 
K. Thus {fj. . . . 5 e rt ) is a A-basis for 1'^ I A" j. called the standard A-basis 
for VJJCf 

3, Let r = Af a (R)andkt 




-c :)■ -c :)■ 
■ ■ c :i- - ■ c ;>• 


then (c l i a * j j. e*i, Cjj} is an R-basis for 3J T (R), since 

(1) if ij ^ ]. | e A/j (R) then 


fa &' 
ft 5, 


- ae M +fl* a +ye ai +Se 3 . 3 


and fe }lJ Cl}, e J|f e 22 } generates Af a (R) over R. 

00 to show that this set is linearly independent over R. consider 


ae 13 +^e ]2 +7e lt 4- 


•--(: 3 










which implies that a = ^- T = S = 0, 

4, We now show simiEarly that J = I, .., nl is a Al-basis for 

M n (K), where t if is the n X n matrix with 1 m the (/./Imposition and 
zero etaewhere, Lf is an arbitrary matrix in M H (A') then 

t°ty) - X af/ e if 
U =t 

and soJ generates jW^tiQ over A'. Consider 

£ = ® 

<,/=! 

where &£ (f,/ = 1, ► ► ♦ * n), then (fl^) = 0, which implies that 
* ( y = 0 (f J = 1.fl) and S is linearly Independent over K. 

5. Let V= K a (C) In Example 2, we saw that {(l h 0), (0, 1}} is a 

C-basris for V. We now show that $ - {II, Q), (i, 1), (0 T i)) is an 

R-basis for r a (C) regarded as an R-space, 

V 2 (C} = Ua,+flj l,& l +fi 1 l)\a l 'a lT p u & 1 GRhSmct 

(a, + 0-2 i,li + jVO “ or(L 0) + a 3 (i, 0) + j3 a {0, I) + j3j( 0, i) h for all 

a lt R. we have that S generates ^(C) over R Consider 

Aj|'l, 0 ) -hotsO. 0 J + jJ,to, D + fc( 0 .i) = ( 0 , 0 ) 

where *], O], ;3 2 £ R, then 

which implies that a t +a 1 i=0,j3 [ + d- 3 i = 0 cr aj -a 2 -|3| = #j =0 
and 5 is also linearly independent over R 

h. It can he proved in a similar manner that 

K1>0,0.0) T (0,1,0,.,„ t O).(0 t 0.0, ]) p (i, 0, .., 0), 

(0, t, 0 t ..., 0),... (0,0,. ., T 0, i)} is an R^basis for V R (C) reprded as 
an R-spaee, 

7, Find an K-basis for the solution space of the system of linear equations 
x - 2 v ■+ 3z - w - 0 
2r + y - z + w = 0 
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Hie reduced echelon matrix of this system is easily shown to be 
I 0 

0 1 a s 
and the equations become 


s l \ 

7 5 I 

7 s f 


— S % —L w 
s* s w 

T^-4 W 


v 5 w 5 

If we give j,w Eht arbitrary values K jej respectively, then the genera! 
solution of the system is 

(jfjr.z r w)= f-A-/i. TK -3ji, 5\ r 5fi) 

= h(-1.7,5,0> + M(-I t -3,0,5) 

i.e. the solution space is <(-], 7, 5, 0 ), (-], - 3 , 0 , 5 )> which is dearly 
an R-basis, 

b. Find an R-basLs iur (he solution space of The differentia] equation 

d 1 y ,, 

—V+> =0 or y h v = 0 (*) 

djr 


where y £ C“(R). This may be solved using elementary cal cuius as 
follows - Multiplying thiOUghout by y* gives 

/y+yy 1 * o 

and integrating 

y 1 +y* =e 3 

where c is an arbitrary constant. Thus we have that 
>■' - y/c*-y l or - y - — = ebr 

y/P^* 

which may be integrated lo give 
sdn" 1 -^.r+a 1 


y - c san (x + d) 

where d is also an arbitrary constant. Thus, we have ihai 
y - r cos d sin x + c sin d cos x 
- 7 sin x + £ cosjf 

where 7 , «5 G R and ihe solution space oft*) is < sin x , co&x>. 
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Now {sin je, cos 1 } is. linearly independent, lor if 
q- sin x + $ cos x = 0 

With a. J? £ R, then by putting x = 0 and x = it/2,- we obtain that fi=G and 
ff=0 respectively. Thus {sin x, cos x \ is an R-basis for the solution space 

off*)’ 

Remark Note the similarity in approach to the problems of solutions 
of linear homogeneous equations and linear differential equations. 

Whereas we have given a systematic method for obtaining a A-basis lor 
the solution space of a system of linear homogeneous equations the 
corresponding problem is not considered tor dillerential equations. 

The first principle method for solving Example & is given for illustrative 
reasons only - for a comprehensive treatment of the application ol 
linear algebra to differential equations and analysis see An Introduction 
to Linear Analysis by D.L Kneider, R.C, K idler, D.R. Oslberg and 
F.W, Perkins (Addison-Wesley). 

Let .3? = { v u Vit . - * t v H } be a A-ba&is tor V. If v£ V, then 

v = £ a t r n where a, E K U « I p 2.ff) are uniquely determined. 

The rMuple (a lr a?,_a n )G F (A) are called the co-ordinates of K 

relative to the A'-basis Jf, sometimes denoted by 

EXAMPLE 

In Example 1 above the co-ordinates of the vector (l, — 1, D 
relative tq the R-basis fvi, 1fe» t>jj are (Li ~ih se- 

0,-ij) “ + 

We have seen in Example I that in general a A'-space may have more 
than one A-basis, in that example we saw that both A^bases have the 
same number of elements, The nexi theorem shows that this is always 
true. We prove 

THEOREM 3.14 Every K-basis of a finitely generated A-space has the 
same number of elements. 

PROOF We first show that if V is a A-space generated by a finite set 
of vectors <, * , v a ), and if f y ^y t . linearly independent 

set of vectors in V then m < n. 

Suppose that m > rt, we show that this leads to a contradiction of 
the linear independence of {jV]. v ?r ...,_>^}. Since V(f= J t ...,fli), 
then 
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>V = I 

r==t 

where £ K. Then, if p £ K (/ = I , r . . „ m) 



Since n < iTi. by Corollary 3 to Theorem 1.7, there exist 

JTT 

■ - - , § m € K (not all zero) such that E (fy § f =■ 0 which in turn 

m /“I 

implies that E == 0 and fy,, r .. , y m y is linearly dependent over 

/-I 

K, This is our required contradiction. 

Now assume that . .fy and {y t . y^) are A-bases of V. 

By regarding {y lr , . ,y m } as a linearly independent sub-set in the 
space generated by (v u ..., the above argument shows tfiai m <n 
Similarly, by regarding {p ]p .*.*»„} as a linearly independent Subset in 

the space generated by {y . y m \ it follows that n Km. These two _ 

results together imply mat m ~ n t is required. 

This theorem now allows us lo make the following important 
definition. 

DEFINITJON 3.15 The number of dements in a K-basis for a finitely 

generated K-space V is called the dimension over K of Vdenoted by 
dim V ot ( V: K ) r V is called a finite dimensional vector space. 

EXAMPLES 

By scrutinizing the examples preceding the above theorem we set that 
C> (^(R)iR)^3 
(ti) (F fl (AO:A)=n 

(iii) (V n (C) : R)=2n 

(iv) JC) = n 2 

(>J (M n (C):R) = 2n\ 

Our next theorem will shuw that a A-basis exists and at the same 
lime gives a practical method for obtaining a A-bash V. We first prove 

LEM MA 3,16 If {ftj,.,,, J is a linearly depend en t set over K in a 
K-space then at least one of the v f ‘s is a linear combination of the 
vectors preceding it , 
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PROOF IF . v H ) is linearly dependent over A', then there 

exist 1 ( ,,,, h), not ill zero, such that 


A 


Z 

1=1 




0 


Let / be the positive integer such that 1 </ < n and Q f ^0 and 
°/+i = %+a™' * ’ = *n” O’ then 


Ql Or_ i 

% = - — 

f a, a } - 1 1 

and the lemma Is proved. 
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THEQ RE M 347 Let V be a finitely gen era red K-spaee, then 
{i} every generating set for V contains a K-basis for V, and (rt) every 
iirwarty independent subset of V can be extended to give a K-basis for 
V r Le r if | v | H ., . . y m | ij linearly independent over A, there exist 

vectors x u ... - x n _ rjJ in V such that [y t . y m . x u ..,, x n ^ m ) is a 

K-basis for V. 


PROOF (i) Let 5 - (jf lp .,. T Jff m ) generate V over Jf. If S is 
linearly independent over A" then S is a A-basis for V r If not, then by 
Lemma 3.16* for some K/< m,Xj is a linear combination of the 
vectors preceding it. If S* = 5\{x‘ | J; , then S' also generates F r over A\ 
lfS r is linearly independent over A then this is our required A-basis 
If not* repeat the above procedure on the set S r and indeed, if necessary, 
repeat the procedure until a linearly independent sei is obtained, Such a 
linearly independent set exists since, for example, any sei containing one 
vector is linearly independent. 

(ii) Since V is finitely generated, suppose that {tfj. v^y 

generates V over A. Let {y u - - ,y m } be a linearly independent set of 
vectors in V, then by the proof of Theorem 3,14 r nr < n. 

Consider the set 


S - {>i. . .. v n } 

then S generates V. If S is linearly independent over AT then it is the 
required A-ba$is. If not, then by Lemma 3,16 P one of these vectors is 
linearly dependent on the vectors preceding it. This must be one of the 
p , otherwise, jf one of they, is a linear combination of the vectors 
preceding it, we have a contradiction ot'The linear independence of 

|yi_; kl this vector be p.. Let S' - S \ {ty}, then clearly S ' 

generates V aver A. If S' is linearly independent over A, we have the 
required Agasis for V. If not repeat the above procedure on the set j', 
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again one of ihe remaining v l must be a linear combination of the 
vectors preceding it. Since by (i) evejy generating set for V contains a 
A J -basis for V, this process must eventually terminate and the resulting 

set is our required A-basis which contains . . . . 

The following corollary is easily obtained, 

COROLLARY I Let V be a finite dimensional K-space with 

{V:K)- n, then (i) any set of n linearly independent vectors in V is a 
K-basis for V; («} any set of n vectors which generate Visa K-basis 
for K 

PROOF (i) By the above theorem, every linearly Independeni set of 
n vectors can be extended to give a A-bads for Kand since (V : A1 = n 
it follows that this set must he a A-b«as far V 

(ii) Again, by the above theorem, evety set of vectors which 
generates V contains a A-basis for V and since ( V : K) — n this must * 
be our required A-basis for V. 

This corollary shows that if (V: A) = n, to verify that a set of 
vectors S — (V|, , ♦, t V n } is a A-baSrS for V we need only show that 
either 

(i) S islincuty independent over A' 
or 

(ii) S generates V over A. 

We illustrate this theorem and its proof by considering the following 
example. 

EXAMPLE 

Let V be the subspaee of V 4 (ft) generated by =* (I, I T 2, 4), 

% 31 (2, ”1, ~5. 2), Pj = 0 P —l t — 4,0), t? 4 = (2, 1, J, 6)1. Find 
(i) an R-basis for V , (ii) an R-basis fur F^(R} which contains this 
R-basis for V 
(i) Consider 

+ ctjpj + otfl p 4 = 0 

or equivalently 

Cl] + 2at * a s + 2ac = 0 

0l| “ £S a — + Cfct = 0 

2ori — $<r 2 — 4 r*j + C4 = 0 

4q 3 , + 2ot2 +* = 0 
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We have 


h 

2 1 

2 \ 


/ 1 

2 

1 

2^ 

/l 

2 

1 

2 

1 

I 

-1 

! 


0 

—3 

—2 

“1 

1 0 
■^+1 

3 

2 

1 

2 

“5 ^4 

1 


0 

—9 

—6 

-3 

1 0 

0 

0 

0 

V 

2 0 

«/ 


\o 

^6 

—4 

-V 

\o 

0 

0 

0 


/i o -i j\ 

0 1 | *' 

0 0 0 0 

\0 0 0 0 J 

wtikh implies that 
Of! = 

*a = 

if wc put Oj = — 1, a* - 0 and a 3 = 0, ft* - H respectively we obtain, 

v* = + 

v 4 = + 4»i 

Thus V = (Vi, v 2t v y , t? 4 ) = iV v v 2 ) and It?,, i? 3 ) is ar R basis for K 
(Li) LeiS = R t? 2l e L , e iP e a- 'a}, where {ei, e 3 , tj. e 4 } is the 
standard R-basis for t 4 (Rl, 

Since 

t?, = (I, 1|2»4) — e, + + 2e 3 + 4e 4 

t ?3 - (2, “1,-5.2) = 2« g - e 3 - 5ej + 2 e + 
we have 

2e 3 + 4e* = t? t - e E - e, 1 
5e 3 —2e* = “i?j + 2e,—e 3 j 

or c, s ^(t?, - 2t?! + 3e v — 3e 3 ) 
e 4 = ^ 5 <.5£>, + 2iti~ 9e, - 3c,} 
which implies that 

F«(R) = iv h di, e lf e 3 , ea, e 4 ) = tei. t?j, Ci, e 3 > 
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(Alternatively,, using the above corollary, we need only show that 
[v u Vi, e h ftj} is linearly independent over R)_ 

We now proceed to obtain a useful theorem which connects the 
dimensions of subspaccs \\ and V, of a A’space V with the dimensions 
of the subspaces V { + V, and V, n J/j. We first need to establish, 

1-EMM A 3,18 Every nub space of a finite dimensional K-space V is 
finite dimensional over K of dimension <,{V: K). 

PROOF Let F* r be a ssihspace of a A-space V. Let 5 be a linearly 
independent subset of W. Then S may be regarded as a subset of V and 
since V is a finite dimensional vector space, it follows from the proof of 
Theorem 3.14 thel 5 contains a finite number of elements and so W is _ 
finite dimensional over A' and {W : A"j < ( V : A). 

THEOREM 3,19 Lei W t and W, be fubspaces of a finite dimensional 
K-space V t then 

CW i: JE) + (W a :Jf) - (WiHW^JO + iWt + IVi‘A) 

PROOF By Lemma 3,8 r IV, n W % is a subspace of V which by 
Lemma 3 .18 is finite dimensional over A", If ( W', ft W 3 ■ A") = r < (V , Jf), 
let {z? lT , „., i? m } be a A-basis for W t n Since IV, n W 2 is a subspace 

DfW E and W f 3> by TheoFem3.]7(iih .^ } can be extended to 

give Abases for W 2 and W 2 respectively ; suppose that 

{ Vu . v r ,*,, * “ »*„ } «>d fa. v r ,J?j. y m ) are A-basts 

for and W, respectively, then (PP,: A) = r + n, ( :K)=* r + m. 

W r c show Ehat5 = {*?,,. v ra x u .,, . y m } is a A-basis 

for fr', + l^j, and (H/j -I- : A”) = r + n + m and this will complete the 

proof. 

We certainly have that S generates W x + Iv', over A', We need only 
show that S is linearly independent over A, Consider 

r FT m 

e Of w f + I fr**+ s y k y k - o 

i = i / — I k= J 

Then we have 

£ <*t% + x JJ, X, = - 2 T- t >,6 h>, n w, 

f’J r=i Jt=l 

Since (t? lT , , . , is a A*hasis for n W %1 thete exist S f e K(f ] r ., ,i-) 
such that 

FPI f 

E W* = Z *i v t “ 0 

*=• i r=i 


S7 















Since now (P!.V y t .is a A-basts for W* and is linearly 

independent ovei A, we have 7 j = ,. . = y m = &t = - .. — - 0 - 

SunUarly „ in can be proved that 

= fc - • ■ • - 0„ - 0 

and wc have 

I 0/1, = 0 
1-1 

which implies that a^ = 0 (/ = I, . _ ►, r) since (Pi, ,. ,, P r } is a A'-basis 
for fi' t n Pv a . That is 

a, = Q(i = I,.r}. 0 , = 0 (f- 1 .«), 

7k = Q<* = 

which proves that 5 is linearly independent over A' and is a A'-basis for . 

w\ + w v * 

This, theorem is illustrated by the following example : 

EXAMPLE 

Let IV, and h J s be the following subspa ccs of P+fR), 

W) = f(ti p 14,7, fi) I a = 0}, h / 2 = {(a, jJ.y, 5} I oc + j3 —y£= 2$). 

Then il is easily verified that 

{( 1 , 1 , 0 , 0 ), (Op 0, I, 0), (0,0* 0 t I)} is an R-basis for W lt and 
0 , 1 , 0 ), (□, 1 , !. 2 )} is an R-basis for J*V 
1 ( 1 , 1 , 0 . 0 ), ( 0 , 0 , 1 , 0 ), ( 0 . 0 . 0 , l) l O,p,] t 0 ) t { 0 a 1 . 1 , 2 * generates 
IV, + h'j over R, but since 

0 ) 1 , 12 ) = 2 ( 0 , 0 , 1 , 0 ) + 2 ( 0 . 0 * 0 , 1 ) + < 1 , l.fcCQ-O'O. l P 0 ) 

and {(I, 1 . 0 , 0 ), ( 0 . 0 , 1 r □>, ( 0 , 0 , 0 . 1 ), ( 1 , 0 , i.O)} is also 
linearly independent over R Li ts also an R-basit for IV, + tV r 
If (o,0, 7.5)^ W,n W tl then 

(3 = a 1 

or 7 = 2 a 

5 =■ 2« j 

and IV| O £V 2 = ((cr s a, 2a, 2a)|ae R} and clearly {(1,1,2,2}} is an 
R-basis of IV, O JV a . We note that (H\ : R) = 3, • R) ~ 2, 

(Jl^ + W t . R) = 4 and ( W t A iv,: R) = 1, which shows that 

(W t : R) + (JVj : R) = (W, + W, : R) + (IV, f\ W % : R) 


a = 0 

20 = 5 
o+0 “ T 
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Exercises 3A 
1. Prove that 

(i) ((1, G, 3), (5,2, I), (0, 1 r 6}} is an K-basis for V t { R), 

(ii) if t is a fixed real number andj?,(:r) = l,£ 3 (v) = x + !. 

fat*) ~ (x + f} 2 f]} is an R-basis for Aj(R). 

2 Prove that {(1,2, 0), (0, 5, 7), (-1,1,3}} Ls an R-basis for V^R) 
and find the co-ordinates of (0,13, 17) and (2,3 J} relative to this 
R-basis. 

3. (i) Show that {(3 + v7 r 1 + yT), (7, 1 +■ 2y/l)} ii linearly 
dependent over R hut linearly independent over Q, 

(it) Show that ((1 — i, i|, (2, —l -+■ i)J is linearly dependent over C 
but is linearly independem over R, 

4, Show thal(i){e r , tin r s r a }(ii){e< sin r, cos f} are linearly independent 
over R, 


S, Show that the subset {<1,0, I, 0,0,0, 2,4)) gf^(R) is linearly 
independent over R and extend it to an R-basis for VVfR). 


6, If {u, p, w} is linearly independent over C in a C-space V, prove that 

(i) + v, fl + w, w + u) is linearly independent over C* 

(ii) (it + v — 3w, tf + 3if— w, t?+ ivj is linearly dependent over t. 

7, Prove that ({1, I „0< ——2, 1,0)} is linearly independent over 
Q and find a Q-basis for F 4 (Q) containing these two vectors, 


8 , 

be 


j(_J J)lfl,5.ci6R andA r = j{^ 
sub&paces of Mi (R). Find R-baws for M, N A M fl N and M + N. 


9. If S and Fare subspaces of ^(R) defined by 
S = ((a, 0 , 7 , *)1« + 3 + y = 0} md T = {{a, 0 , y, fi) 1 7 = -fi}, 
find R-bases for 5 + T and SftT 


10. Find an R-basis for the solution space of the equation 

x —2y + r — 3f ^ 0 

11. If V v and Vi arc 2-dimensional subspaces in F r 3 {RK prove that 
(P' t n F 3 : R)>0. 

12. Let U be the subspace of ^(R) generated by the two vectors 

“1 = <1,2,3), u 2 = (3. -5, I >. Show that (1,0.0) is nut In U but that 
\ 5, —23, —9) is in U. Express the latter vector as a linear combination 
of u | and u 2 . 
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13. Determine whether or not each of the following is an R-basis for 

PJR) 

(I) (!, 1 + t t I + t + t 1 .1 +t +... + t“ } t 

(li) [1 + t,t + f 3 ^ .+ 

(m u. i -t .(j -tr). 

J4. Are the vectors u — (3, “1,0, —1} and v = (I, G, -I, —I) in the 
subspace of KiCR) generated by {(2*— I, 3. 2), (— 1+ 1, E —31, 

(I , 1,9, - S)}' ? Hence determine two R-bases of F*{R) one containing 
u and one containing V. 

J5. If Sis a linearly independent set of vectors in V and pG V. prove 
that v £ iS} if and only if S U } is linearly independent, 

Show that the let S — ((I. Q t -1,1), (2,-1, 0 t I). (l. 1>2,1}} is 
hnEariy Independent over R and that x — (l. 3, 3, 7}?= {$) and 
y = (0, | F 1, —1 j ^ <S). Find an R-basis for iS > which contains .t and a 
ft-basis for I^(R) which contains y, 

16. Show that M% (C) may be regarded as a t-space and an R-space and 
determine its dimension in each case, In each case, determine the 
dimension of the subspace generated bv 

|G M M tic !)]• 

17* If S and T are subspaces of Kj(C) generated by 

Kl.l.O), 0.1 + i, I).(l +i, 1 +i,0))and {(1.0, 11. (j, -i. 0), (0, i, i)f 

respectively, find C-bases for5 fl T and S + T. 

Regarding the above as real spaces, show lhai if S' and f r are the real 
su bspaces generated by the above se ts, prove th at 5 1 n F' = {0} ^ 

18., | et V be the subspace of P 3 (R i generated by the polynomials 
1 — t 3 + r a , 2 + 1 — t 3 + r 3 , 3 4- 2i + r 1 — I 3 . Show that 
fit) - t + t 1 -T 3 e Vhuig{i)— Find an R-basis for V 

which contains/(f) and an Rbasis for wliich contains git). 
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CHAPTER 4 


Linear Transformations 
on Vector Spaces 


4,1 Linear Tra reformat ions 
Let Find W be Auspices. 

DEFINITION 4.1 A linear transformation [K-homomorphism I T 
from V into H*' rr a mapping 7 . V -+ W such that 

Tipv + v 1 ) — aT’d?) + T(v *} 

for all ft tr K, V. V EF V. or equivalently 

T(v+t>'} = T(v)+T(v') 

T^fttfJ = 

for all a £ A\ v, V £ V. If W = V then we say that T is a linear 
transformation on V. 

Essentially, a mapping from V into H' is a linear transformation if it 
respects !he two basic operations in a vector space, namely addition and 
scalar multiplication by dements of A', as illustrated in the following 
diagram - 



Figure I 
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The following examples illustrate [he breadth of the concept of a 
Linear transformation- the first two show that it ls a generalization to 
arbitrary vector space? of some well known "transformations" in the 
plane 1' 3 (R), namely reflection in a line and rotation about a point. 

EXAMPLES 

1. Let L be a line through the ortgm and let T be the mapping which 
reflects each vector in L 



1. Let R be a rotation through an angle 8 about the origin 
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3. Lei T ; Pj(R)-* L a (Ribe defined by 

r{Q], Q 1h Oty) = (tt, + ftj, % -Oj) 

then T is a Linear transformation of lj(R) into f'jtR) since if 
(aua^aj, ft, V z (Rl a e R then 

7’( a (oi 1 ,a 3p o a ) + = rfact] + ,3 1 , ocki + 0 S > uecj + j3 ? j 

= + 0t +■ erQj 4 0 3 , Ceaa; + 02 — OQJ — 03) 

- a(ori + a 7r Qj - a 3 ) + (0 t 4 ft —j3j) 

= aTfai, qj, o 3 ) 4 rOJj. £k, fis) 


4. Let T : F g (R) -*■ F a (R) be defined by 

T(tr| h n Jf Qf 3 ) = (a, + 1,Oj) 

then 7 is not a linear transformation since for example T{ L G r Q) = (2,0) 
and T{ 2(1,0.0))= 7(2,0,0) = (3,0) and 

r{2(] ± o,o))^2rn,o t o)=(4,o). 

5. Lei Z):/* rt (R) — /^(R) be the differentiation mapping defined by mapping 
a polynomial onto its derivative 

£5(ada + Qjjr 4 . .. 4- a^x*) = 4 2 q2X 4 4- ,. , + a 15-1 

then D is a linear transformation on T^tR.1 since if 
«, o^0 f € R(i= I.n) 

+fl|Jt + 4- + « fl * n ) + Cfo +liJ 4 . .. + 0 n * fl )> 

“ t>({aa Q 4 0 O ) 4 (aa, 4 0 j)jc 4 ,., + (ote^ + 0 n J Jr n ) 

= (M] 4 0!> 4 2(ojfltj + 0 2 )x 4 ,.. 4 nfortt,, 4 0 ft )jr' ,_l 

— «£J(a Q + at Jr + . H , 4 a tt jt") 4 D{$q + ft* + . * * 4 0 rt 4C n ) 

6. More generally, let D map a continuously differentiable function on 
[n.bj onto its. derivative, that is D : C'|u,b] ■ C[a,h\ Is the derivative 
map. Then D is a Linear transformation since if a G ft, J\ / a G C"'[u.i>], 
then 

m +/ } )=inr,)+jxr 2 ) 

Dftt/i) - aOifi ) 

are restatements of well known properties of determinants (see A.S.-T. Luc, 
Bask Pure Mathematics II r VNR New Mathematics Library 5, p.56), 
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7. Integration of functions is also a linear transformation; more precisely, 
i f/eCM] define 

m = /; /(0 

where u ^ x < ft. Then J . C[u.h] — and 

sow,)- r 

a 

- f /i(f)df + 

at ii 

= sa,>+s(/i) 

and similarly 
for /■,. e C[j,ftl 

Let M and N be fixed m a m and n y n matrices respectively, Define 
T.M m rt (A)by T{A) = M4N for all A Gi*^ „(*), than 

if ^ n (JQ, and a E K we have 

7(el 4 + 5) = M(cbf + fl)N 

= qM.4N + M//N 

= <xT(A) + T(B) 

i.e. I is a linear transform a lion on M iK) 

■rTj ^ ' 

9„ If V and W arc A-spaees, then / : VV defined by /(t?) = v for all 
t'€ V is a linear transformation on V called the identity transformation 
and 0 : V -* W defined by 01 v) ~ 0 lor ail t ri E V is a linear transformation 
from V into W called the zero transformation. 

Remark / 7(0) = 0 since by Theorem 3,2 wc have 0 + 0 = 0 which 

implies 7(0) ■+ 7(0) = 7(01 and 7(0) + 0 = 7(0) and the result follows 
from the uniqueness of the ^cro element (Theorem 3,4). 

Remark2 If v i; e y. e ( ef.(i= |. n), then 

T I E a ( v i ) = I T(v f ) 

\/=i / r=i 

This result follows by repeated application of' the definition of a linear 
transformation. 

We now prove a theorem which will be useful later when the existence 
of a linear transformation with certain properties is required. 
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THEOREM 4.2 Le i V ami W be K-spaces where ( V: K) = tt< «*, 

If {V . . . is a K-basis fur V and f w,.w n } are arty n vectors 

in W r then (here exists a unique linear transformation T: V-* W such 
that Tty) = w t (i = 1, 2, , , r «). 

n 

PROOF If t 1 e Vy then v — E a. p.. where i r .., , n) are 

(~i 

uniquely determined, Define 7: V W by 

7(u) = T j S *V I = S “r w t 
\f=i J i=i 

n pi 

.11 Vy F £ f r a£f and V * E a f n ( -, v " — E where 

i =I i = t 

aify&j E.K{i— 1. n) then 

Tiw+v ) = T | £ ( Qft, + 0 f ) s?,J 

FJ 

= £ (aa i +&i)w t 
i=l 

= 0:7(1?) -H 7(1?*) 

and so 7 is a linear transformation of V into to 1 . which clearly has the 
property that T{V { ) = (i = I, n). If $ : V-* W is a linear 
transformation with [fie sume property = w, (r = 1.... 7 n) then 
if i?€ V and i? = E ar f £f- T ^ E K (i = l..... n) then 

J(p) - S / £ v\ = x *i Sty) = E = T(v) 

\i~l j i-L i= 1 

and .5" = T, which proves the uniqueness of 7. 

Exercises 4.1 

I. De term me whether the following mappings I : Fj(R) -» Fj(R) are 
linear transformations 

(i) r(a,& 7 ) - (a + it—r,2a+&) 

(ii) Tfaby) - (c*+ ] p a+2J3-7) 

(hi) 7 ) = (Ior 1,0) 

(iv) 7 (q.j3, y) = faftjSa), 


95 














2, Determine whether the following mappings 7 :M n \K)-> (/Cl are 
linear transformations 


(i) T(A } = AS, where S is a fixed matrix in M n (AT 

(ii) 7M) = /f $ - S4, where S is a fixed matrix in M n {K) 

(lii) T(A) = A 1 

(tv) T(A) = A\ 

3, Determine whether the following mappings 7 ; C* (R) Gf R) are 
linear transformations 

(0 r(/M> = /’(*) 

(u) r(/(x)> = /’ /(f) it 

(hi) rtf14) = M fix) 

(IV) Ti/ix)) = *m 

(v) Tifix)) = f{x + I), 

4. (i) Define T : C z (fc) -qil) by T(f(x)) =f(x) - 2f(x) + 3, 

Show that 7 is a Linear transformation; 

(ti) If 4r), b(x) e OR), define 7 : C : (R) - OR) by 

m*)) =r(*)+<fa)f t (x)+b(x)m, 

and show that 7 is a Linear transformation, 

4.2 The Matrix of a Linear Transformation 

Let V and W he finite dimensional vector spaces over A', where 

(T:Il) - n, (IV : K) = m. LetJ?— (w,.u fl } and if - {w,.,, - P w^} 

be A bases for V and W respectively. For / = 1.n, /V. e W and thus 

Tv f = S a tf w i 
f a l 

where € A" are uniquely determined. Let A - (Oj ) n (A'}, then 
A is called the matrix of T relative to the A-hases ^and yir "and is 
sometimes wriTien • Note that the coefficients involved in Tv ( 

give the elements of the/th column of A. 

Conversely, if/1 = (A% define 1 A : V-*• Why 

T A V j = S^/Wj 

then by Theorem 4.2, 7, is the unique linear transformation with this 
property. Thus, there is a one-one -. rreijiundence between the set of 
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linen transformations from Pinto Wand the set of all m x a matrices 
over K. 

If 7is a lineat transformation on V, we denote by (7^. 

H'e consider in particular 3 linear transformation 7 from V (A') into 
KJK), U(x lX2 ,,,., xj e VJKI then put T(x t , x 3 ,... , xj 

- LVi. 7 j-€ V m QQ- If and if 

~i e u e i . e' m ] are rite standard A-hascs for K rt (|Qand l) r {K) 

respectively and^|7)^ = (a^), (hen for /=1, + *., n 

m 

rfc/) = iv! 

= .°W> 

Hi us, we haw 

tVu.Vi, > ♦ *,>„,) = T(x lr x 7 . . *. , xj 
= £ *i Tty) 

h 

= S Jt;(aiy,a,......a„,> 

or in other words 


>V ~ Z 

i=i 

This means that Lf T: V n (A") -+ V m (A) is a linear transformation and 
A = ( Q j'y) e „ (it) is the matrix of 7 relative to the standard A bases 
for ^(A)and VJtC) then 


T{* it*a.Jf ft ) = 


U/ 


2 <ht*r 
/=' 


1 I fO 


Conversely, if 7; V n (fC) -*■ V m (K) is defined by (1), then it is easily 
verified thaT 7 is a Linear transformation. Hence every linear transform¬ 
ation from V n (K) imo V m (K) must be of this form, Nett that if the 
linear transformation J is presented in this form, the rth component of 
7 (jci, . . . ( x n ) gives the elements in Lhe rth row of the matrix of 7 
relative to the standard A-basii for V a (K) and V m {K) 
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EXAMPLES 


1. Let T: ^(R) -+ f^(R) be defined by F(a, ft 7 J - {a + j3 — 7 . 2a + 7 ) 
for all (dc, 7 ) t= (R), Then, by the above. F is a linear Transformation 
and the matrix of F relative (o the standard R-bascs for Fj(R) and 

v*m is 



Now, Eet = ft?, = (1 , 0 ( -i) T ( 1 . 1 , 1 ). tJ* =*(I T 0,0)} and 
3/"= (w* ~ (3, IK w*=(l t Q)} then it is. easily verified Thailand 
a are linearly independent over R and are R-bases for Pj(R) and 
Vi{K) respectively. We now determine the matrix of T relative to M 
and H We have 


TVi = T( KCl.-l) - (2J) - + w s 


rpj = r(i s i, 1 ) = ( 1 , 3) = 3w l - iwi 

Tih - mo, 1) = (1,2) - 2w t -w a 


and so 




CO* = 


1 3 2 

I -2 -I 


2. IttR : V 2 (R)— ti(R) be Lbe reflection on the line L with angle 0 
through the origin, We find the matrix of R relative to llie standard 
K-bases for ^(R). 

To determine this matrix, we must find R ( 1 , 0 ) and R(Q, 1). From 
Figure 4„ we see that 

R(I.O) = (cos 2$, till 2$} 

R(O t 1) = (sin 20. —cos 20) 

and the required matrix is 

/cat 20 silt 20\ 

\sbi 20 —cos 2 0 / 
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3. Let R be a rotation through an angle 8 about the origin in ^(Ri 



In this case 

R(ljO) = (cos 0, sin 0) 

R(0, I) - (—sin 8, cos 0) 

and so. the matrix of R is ( Cm f 

Um8 £0$$} 

4.3 Change of Basts 

In the first example on page 98, we saw that the matrix of a linear trans¬ 
formation is dependent on the choice of basis. We now investigate more 
closely tire effect of a change of A-basis on the matrix of a linear trans¬ 
formation. 
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Before proceeding to the main result we prove the following: 

LEMMA 4 3 Let fa, tfc, * * <, f„} be a K-basis for V and 

n 

v- - X tx t j v t Q m 1,... t n) f then {v\, ft£.p^) rj linearly 

independent if and only if A = In., t € M tl (tCj is an invertible matrix. 
PROOF Consider 

2 3,W = 0 

/ C 1 

where ^ G A' (/ - 1, 2 ,, , , , nf Then 

,l,Mi^V |=o 

i,e. 

But {v u ■ v n } is linearly independent over K, anil so 

ri 

Z Gj, 0- — 0 (i “ 1, , . . , ri), This is a system of n Linear equations in n 
1 f r 

variables which has 3 nontrivial solution if and only if .-I is a singular ■ 
matrix, which implies the lemma, * 

COROLLARY 4 matrix A is invertible if and only if its columns 
{rows} are linearly independent over K. 

Let T: V -+ W be a linear transformation where (V : A') = n, 

(W :K) ** m. Let S = {tr Ll Uj. v n } and y = \w u w 7 , - w m ) be 

Abases for V and to respectively and let ^{T)^ =A =la fj )£M fr] n 0C) be 
the matrix of T relative to S and if i.e. 

m 

Tv f = 2 a (/ w, {/ = I, .. , , it) 

( = t 

Now, let J>' = f v[> Vi .if} and ^w| p »£j also be 

tf-bases for V and W respective! > and let ~B = (£. >E r /, r| n fVO be 

the matrix of T relative to S and V The, 

Tv/ = I few,' ft- 1*2 
*=! 
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Now, df and-#' are K -bases for V and by Theorem 4.2 there exists a 
unique linear transformation P on V such that Pv } = v/(J = 1,2,,.., n). 
Similarly, there exists a unique linear Transformation Q on W such that 

Qw, = */(/= h 2 . m) r Let C= (y^G^K) and 

D = (fijy) (AfJ be the matrices of P and Q relative to the tf-basts 
S' and respectively Le, 

v j = Pv - £ 7 p f C/ & i* 2 
t-i 

and 

m 

*} = Q^t = Z^it w t 0 “ 1 - 2-.rn) 

Then, for / = 1, 2,. „, , rt. we have 


rrr 



and alternatively 

Tv h Wzt,*, 

= i i u I 1 ^ w« 1 

jf=i \tf=i ; 

m t n \ 

= 21 <*r% w fc 

*■1 v=i ) 

Thus, we have [wo alternative forms for the matrix of T relative to the 
A’-bases S and if , namely 

-DB^AC 

By Lemma 4.3 proved above, we have thai C and D are invertible 
matrices, thus 


B-D'AC 
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Thut, we iiave- proved the following: 

TH FOKfcM 4.4 Let T be a linear transformation from a A -space V into a 
K-space H r . // *8 and 38 are K -bases for V and it and V ' arc K-bases for 
W r then 


*rflV - =®)> ("• 

where B is the unique linear transformation which imps 38 onto %> 'and Q 
is the unique linear transformation which maps tf onto H '. 

This theorem is illustrated by applying it to the first example considered 
or page 98, Using the notation of that example, then 



which conforms with the result obtained there. 

We now consider the particular case when T is a linear transformation 
on V in more detail. In lliis ease, we let the A-bases .S?and it coincide 
and (he A'-bases M and H " coincide. This means now that D = (7 and thus 

CDj< = cr l m# c 

We give a special name for matrices connected in this way. 

DEFINITION 4.5 // A, B £ M n [K}, rhen we say that B is similar so A 

if there exists an invertible matrix C € M (A) such that 

B = r 1 AC 

In fact, what we have proved above is that if A and B represent T 
tel a live la certain A'-bases for V, (hen .4 and B are similar, The converse 
of this can also be proved. We have 

THEOREM 4.6 Let A, B t V r ,, (A" i then A and ft are similar if and 
only if they represent the same linear transformation on a vector space 
V of dimension n relative tv suitably chosen K-bases for V, 


W2 


PROOF If A andi? are similar matrices, then by Definition 4.5 there 
exists an invertible matrix C e M n (K) such that B = C'MC Let V be a 
A'-spacc of dimension n wi(h A'-basis {u h tfj r «.., v } and let T’bc the 
linear transformation 7'on U defined by 

^ - J *ifVt (/= 1.w) 

For; ~ [, 2 t ... * n, let 
V * £ -rtf 

where C - ( 7 ^) and C 1 = ( 7 ^). Then by Lemma 4.3 since C is 

invertible. (tf t . vf .x? n '} is also a A-basts for V. Furthermore, for 

/= 1 * 2 , ,n, 

*V = 

^ i fl -k 

~ *5. ’* 

* * » 1 / n v 

_ j^ 

= £ f I £ T4*Af^) p l 

G = I \j(r — J /=! / 

Thus, the matrix of T relative to the A-basis {v, \vi\-- . ,P„ r } for Vis 
T ' 1 AC = B. This completes the proof since the proof of the converse _ 
has been given before the Statement of Theorem 4.6. 

EXAMPLF Let J$= {w, t?, w) be a A-basis for a 3-dimensional 
vector space V and let 
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be xhe matrix of a linear transformation on V relative to this A-basis. 
Find the matrix of T relative to the A"-bas]s.^' = fw + v, e/ — + w, 

v— w}. 

By the above theorem, the matrix 

(' ' °\ 

C * M -2 1 

\0 1 “1 / 

and by Ehe methods of § 1 j 6, we can invert this matrix to give 



Thus, by Theorem 4,6, (he matrix of T relative to the A-basis^ r is 



Exercises 4.3 

L Let T be a linear transformation on ^(R > defined by 

Tfay,z) = fc-y,x + ly—x t 2*+y +g) 

Find the matrix of T relative to (ii the standard basis for FjfRh 
(ii) the R-basis \v u v it Dj J for Fj(R), where v t = (1 3 0, 1), 

Wa = <- 2 | 

2, The matrix of a linear transformation T on f j(Rj relative to the 
standard basis is 
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Find the matrix of T re la live to the R-basis {v u pg} where 

*h=u.o, i} 1 ^=e 2 ( u)^=(i T -i, i). 

3. Find the matrix of the linear transformations T onP n (R) defined 

by (a) T{f(x)) =/(x)(b) rCf(*» = /'(x+I> relative to the R-basis 
(0 {!•*,**.* n ), (it) 

(hi) U. J +x, 1 +x + x 3 .1 + .r + .. J + x n }, 

4. If 5 is a Fixed, matrix in (R), find the matrix of each of the 

following linear transformations IT on M 2 (R) relative to the standard 
R-basU 1^1 J,/ ^1,2)} 

(i) TA = S.4, (ii) TA = AS r (iii) TA - SA -AS. 

Sr If fui, Uj} and [v u P,. t^} are R-bases for F 2 (Rj and l j(R) 
respectively and if a linear transformation Tfram V 2 (R) into ^|R)is 
defined by 

Tu t = y, + 2Vi — ir 2 

- Pi —fa 

find the matrix uf T relative to these bases. Find also the matrix of T 
relative to the R-bases {— u, + u 2 , 2u t — u%} and 
\ y lt v x + Vj, P| + Wj + tf 3 } for ^j(R) and F S (R1 respectively. What j; 
(he relationship between these I wo malrices g 

6 . If U and Fare A'-spaces of dimension 1 and ~Jt= {ir L , 

hi i\ 

®= (*i, *%, M “^0% = I X » .find UT)„ t whore 

\ 1 X 2 jU7 

Jt* - {Ui + Ui± u a , + (31 + I)ii 3l uj} 

Hence or otljerwjse, Imd the values of A and ^ for which (he system of 
linear equations 

x + y+ 2 = | 

x + \y + juz = 2 

x + X a y + jr 1 ! = 4 

has (j) a unique solution (ii) more than ore solution, 

7. Find an R-basis for the vector space of all homogeneous real 
quadratic polynomials in three indeterminatesx^y and z, Show that 
she mapping which lakes such a polynomial fix.y.i) into 

/(oof +y + z, + yjr, 0) is a linear transformation and Find its matrix, 
relative to this K-basis, 
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g. Let U be the vector space of ail real quadratic polynomials in two 
variables x andy and V the vector space of all real cubic polynomials in 
one variable t, Find R-bases for U and V, Define T : t. r -f V by 
Tif(x,y))-f(x, 2). Show [haI Fis a linear transformation and find 
the matrix of T relative to the R-bases for U and V. 

4.4 The Kernel and Image of a Linear Transformation 

Let Land W be A-spaces, ami let T he a linear transformation of V into 
W. We now introduce certain subspaces of Land W which arc important 
in later applications; Put 

ker F = {vm ViTv = 0} 

and 

im F - {F(tf) | it£ V) 

Then the following lemma is prove d- 

LEMM A 4.7 ( 1 ) ker T is a subspace of V t 

(it) im T is a subspace of JK 

PROOF (i) ker T is non-empty since 0 e ker F If v, v' E ker T and 
a £A', then F(t?) = T(v) = 0 and T{av + v’} = &F(v) + T(v') = 0, 
that is <xv + p r £ ket T and ker T is a subspace of V, 

(Si) im Fis non-empty smee F(0)e im F. If w, w r E um T and a £ A, 
then w = F(tr) and w' = T(v’) for some if, v'E V, and thus 

aw + w r = aF(v) + T(v) 

— F({m> + 1 /) 

where *i' + v' G V t i.e. aw +■ w’ E im T and im T is a subspace of W, 

If V and Ware finite dimensional vector spaces over K, then ker T 
and im T are also finite dimensional over A and we can give the 
following 

DEF1NIT10N 4 ,8 nullity T = {*& T: if), rank T - (im T: K). 

The rank and nullity of a linear transformation are connected as 
follows.. 

THEOREM 4.9 If V and W are finite dimensional vector spaces over 
A" and 7 a linear transformation of V into W then 
nullity T+ronk T = (V:K) 

PROOF Suppose that nullity T = r and let t v r ) be a 

A-basts for ker T. By Theorem 3,17, this A-basss, for ker Fean be 
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extended to give a A-basis {V u . . . , v ri t/ r+ |t + , , , for V, 

if n = (V ■ K), By definition of im F, it is dear that jFr'j, Tv 3 . Tv n ] 

generates im F over A. But Ft', - 7Vj — , , „ = Tv r = 0, since 
tfi, v lt ., , , v r £ ker F r which Implies that (Ff Pi . Jt generates 
im F over A. We show that this seT is also linearly independent over A" 
and hence is a A-basis for im T and the result will follow, j.e, 
t+(n-r) = n 
Consider 


“r + |HW + 

■ - + a„Ffu n ) ■= 0 

then 


F(or r+J % +I + - 


and G r4 1 o f + , F ,., + tn n ir ft e ker T. But .pi, v ir .. 
for ker 7 and thus 

*V+j *V+i + ■ ■ ■ 

+ ft H v n = ft p t + - ■ » +JJ r *V 


for . . . .JS r £ K, or in other words 

Since (Uj;,,., v n } is a A-basis for V and is linearly independent over A. 
we have in particular that a r _, — ,,, = a n = 0 and ( T{v r _ 

F(p n )} is linearly independent over A. 

EXAMPLES 

E. Let T, F 3 [R ) -> ^(R} be defined by 

F(a,, a 3 , ttj) - (a, -h 2 q 3 - o Jr 2a, + e a , oc, — 2 + 2«jI 

Then Fis a linear transformation on V 3 ( Hi, We now determine R-bases 
for ker T and im F. Wc have that 

imF *= iFta^a^a^j = n,( 1.2, 1) + o st 2.0,-2) 

+ a 3 (—1, l, 2) J u lr ct 5 , a 3 € R } 

Thus 1(1,2, I), (2.0, ■—23.1—1,1,2)} generates im Fover R, 

Since 

- 4(1-2,1)-1(2,0,-2) 

Jitd {(1,2, 1), (2 1 0,-“2)} is clearly linearly independent over R it 
follows that {(1, 2, 1), (2, 0. —2 >} is an R-basis for ini T and rank T= 2. 
By the above theorem, we have Oral nullity T - i F’jfK \ Ri — 2 = I. 
Now. (« Ir q 3 ,q 3 1 E ker F if and only if 
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ci] + 2aj - a 3 - 0 
= 0 

Qi — 2a 2 + = 0 


From 


2 

0 

2 



we deduce that this system reduces to 
<*i - -iaj. Hi “ i « 3 
Of, ifi other words 

kerr = W—U. Dla,eR! 

and {(—2 t 3, 4J) h an R-basis for ker 7: 
2* Lei 7" rC*{R) - OR) be defined by 

W=r? + j'. v e c 2 (r) 




Then if h easily verified that Tis a linear transformation. 
Now 

kttT^iymC 7 ^) I JXv) = 0) 

M>-ec ! (R> I +>■ = 0} 

lLc - 5 


Thus, ker Fis the solution space of the differential equation 

a-- 


which was completely determined in Example 8 , p. HI. 
3. Let T: F^fR) — V % |R) be defined by 

T (jr. y t £, w) = A A r 

( l _2 3 _j\ 

2 | _ j j j ,2f*“ ( xy^wX then 

ker T - {{xy\i , w ) L A X - 0 \ 
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llius, ker / is the solution space of the system of linear equations 
determined in Example 7, p. 80. 

The application of the ideas introduced in this section and illustrated 
by this last example to the solution of [incur equations are developed in 
tne 1mal section oi this chapter. For a discussion on the corresponding 
problem for Linear differential equations s« D.L Kiulder, R.G. Kuiler. 
D.R. Ostberg and F,W. Parkins (he. ci'r.), 

Exercises 4,4 

J. Lei F f 4 (R) -*■ F 3 {R) be the linear transformation defined by 

n®h ^3, •**) =■ {*] — aj + Oj + og,, a, + 2a a — 4- o^, 

3g 2 — 2 a 3 ) 

Find R-bases for ker Fand im T. 

2, Find She rank and nullity of the linear transformation from V A \ R) 
into F'a(R) whose matrix relative to standard bases is 



3. Find ker Fand im T for all the linear transformations defined in 
Exercises 4.J r No, 1. 

4, Find the rank and nullity of a linear transformation T from k*(R) 
into l j,(R) defined by 

F< n ], ocj, aj h a*) = I.Qf] — dcj + 2f*4, ”2*! + a 2 +■ 2a 3l a 5 -+ 4a*) 

Show that (1 .3. k) is in im T if and only if k = 5 , 

Find the condition for (I, x t l,y) to be in ker T 

1 Let V denote the real vector space of polynomials f(x,y) with real 
coefficients of degree not exceeding n in two variables Jr and y, Show 
that the mappings S and F defined by 

Wa,>>» - - g+>g,= ,> 0+,* 0 

ate linear transformations on V. Find the kernel and image of S and T 
Find an R-basis for V and find the matrices of S and T relative to this 
R-basis. 
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6 , I_ei V be tls-e vector space of real functions which have derivatives 
of all orders.. Ii‘/> as the derivative, find 

(i) ker D, (ii) kwD^in > l)imd (lit) k*r(£»-l). 

7, If S = (] \ find R-bases for ker F and un 7 for all the Linear 

transformations defined in li semises 4,2, No, 4, 

8 , If F js a linear transformation of u vector space V into a vector 
space W, show that the dements of V which are mapped Into a given 
subs pace U of W, form a sub space X of V. Ii the dimensions of V t W, 
U, X are m. rt, p, q respectively and it the rank of T is n, find a relation 
between m, ji, p, q. 

Let V be an ^-dimensional X-space and 5 and T are linear trans¬ 
formations on V, prove that 

nullity | ST) < nullity S + nullity T 

If S n = 0, but .S '* -1 ^0, determine nullity S. 

10. If S .U^ V and F: V~* U are Unear transformations, prove that 

rank T - rank .ST< (£/ X) — rankS 

11 . Fmd a linear transformation F on some vector space F' such that 
ker T = im F. Can this be done for all vector spaces'! 

12. If V is a X-space, prove that 

imrn ker T= {0} if and only if Ft Tv\ = 0 implies Tv- 0, where 

i?e v. 

13. If T is a linear transformation on a Unite dimensional X’space V 
and rank T 2 - rank F, then im F r "< ker T— {0}: 

L4. If T is a linear transformation on V such that F 1 = F. prove ihat 

(i) ker T= im(/ — T} r ker(/ — T) = im T 

(ii) ker Tn\mT= 0 

(iii) every vG V can be uniquely expressed in the form v = V\ + v %) 
where € ker F, € im F. 

4.5 X-ismorphiisms and Non-singuLar Linear Transformations 

We now connect these ideas with other important concepts in algebra, 
namely X-isomorphisms and non-singular or invertible linear trans¬ 
formations. 


DF F INITIO N 4,10 A linear transformation ('A '-homomorphism \ 
T;V-* Wi& called 

(i ) a K-isomorphitm if T ii a bijective mapping , r.e. F is infective 
(Tip) - T(v') implies v = v)and T is surjective {if w e W t there exists 
a v € V such ihat Tv — w). 

(ii) a nan-singular transformation if ker T — (r’}} . 

Let T: V ** W and S: W-*- U be X-isomorphisms, where V, W r U are 
X spaces, then ST- V-* U defined by (ST)(v) = $(Tv) lor all se V ii 
bijective, and is also a linear transformation since if o€ Jt N v t u'E V 
l lien 

[ST){<rv + v*) = S{T(av + v )) 

= SUxTify + Tiv*)) 

= oJ(F(u)) + 5<F(u')) 

= *ST(tt) + ST(v') 

II F is a A"-isomorphism of V onto h, then since T is a hi;ecLive 
rnappmg F 1 : W ■* l^is also a bijective mapping and is a linear 
transformation from W onto V since if w,. w 2 E W and a E X T then 
= Ft|, w 2 = Tvi for unique v lt UjE V and 

T‘ l ( orn'i + Wj) = T^&TVi + Tth) 

- 7^ 1 Ffcroj + pj) 

= nflj] + Ifj 

— ftF _l Wj + 7”’wi 

Tlius, F is an invertible linear transformation. Conversely, If F is an 
invertible linear transformation, then F is aX-isomorphiSm and thus 
these two concepts arc cquivaleiit, 

We now show that if the two A-spaces V and W are finite dimensional 
and have the same dimension then the concepts of invcrlibie and non- 
singular linear transformations are equivalent, In fact, we show that 
these are equivalent to various other statements. 

THtORLM 4.! 1 Let V and W be finite dimensional K-spaces kVl'F^t 
( V A") = (It-'; K) = n and Ta linear transformation of V into ft' Then, 
the following statements arc equivalent 
ti) T is a K^isomorphism 
(ii) T is invertible 
(in) T is infective 
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(iv) T is non-singular 

(v) rankT = n 

(vi) T is surjective 

(vii) if {v it .,. , v a ) is a K-basis for V, then 

{ TiVtl TM . T(v n ft is a K-basis for W 

PROOF In the proof we show that 

(i) *(iJ) * till) - (iv) * (v) *{vi)-*(ini) =■ Oh 

which will imply that all seven statements are equivalent. 

0) = fii) has been proved above, 

Cii) ^ (iii) is a well’known for maps in genetal. 

(liil =* (iv), Let tfc ker T. then 7"ft 1 ) = 0 = T(Q) and as T is injective 
V — 0 and ker 7' - f0} and T is non-singular. 

Civ) =* (v). If T is non-smgular ker T = CO) and nullity T — 0. By 
Theorem 4,9 we have rank T = (- n. 

(v) =» (vi). By Lemma 4,7, im T is a subspace of K If 
rank T = n — ( W : K) then Lm T - W and T is surjective. 

(vi I =* {vii). If T Is surjective, then if w € W, there exists a v E V such 
lhai Tt 1 = w. if {tv , h v R } is a A r 4}a*is for V then 

n ft 

v— t a t v i ,. a f e K (i = t *..., n) and w = Tv - £ « f T(v { ), 

i.e. ITfn,'), , T . r t' rt )) generates W. By Corollary I to Theorem 3,17 
this must be a A"-basis for W, 

(vii) =* fi). Let n. t>*&. V such that Ttv) — T(i/). We have 

ft n 

v — Z a t v i . if = £ v t k ot fi (/ = J „.„., n ) and thus 

f-i 

(^-0,m<g=o 

But {7"<) r . , . , TivJ] is a A r -basis for W and so = |3 r tr = I,. . , . n), 

n 

i.e. v= V and T is injective. Let w € W. then w- S a,- F(ty, or 
/ » \ fl 

f £ o, vj — w with E o, i?;£ V and Tis surjective. Thus Tis a 

/ f=t - 

A’-isomurplrism. 

In particular, we note that if Tis <t linear transformation on a finite 
dimensional vector space V then die concepts of A-i so morphism, 
invertible and noTt-stiiguJat -ire equivalent, and furthermore, to prove 
that a linear transformation is invertible wc need only verify that it is 
either injective or surjective. 
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We now prove iwo useful results concerning n on-singular linear 
trunsformal ions. 

THEOREM 4.1 2 If Vii a finite dimensional K-space and S. Tare 
linear transformations on V T is non-singular, then 

rank I734 — rank S - rank ( ST) 

PROOF If PE im(Sf) then (ST)(v) = S[J'{v r )} for some i/e V, 
t.c. t?€ imS and im{JT)£ Lm S , Conversely, If tm5, then P= S(V) 
lor some n r E V But T is non-singular and so in particular is surjective 
and so there exists i?"e F^uch that T{v*) = v\ i.e, v-$T(v"\ 
if€. and imj = imiT and rank $ = rank ST. 

Now if t 1 e ker S then S(v) - 0 and so TSiv) = 0, i.e, pG ker TS and 
ker S’ C ker TS. It p€ ker TS then {TS) (th = 0, but T is non^slngulai 
and sq S(v) = 0 and v e ker S. U. ker S ~ ker TS. 

Hence, wc have nullity (TS) = nulhty (S) and by Theorem 4,9„ ii - 
Follows that rank TS — rank5 as required. 

f HEOREM 4.13 If S and T are linear transformations cm a finite 
dimensional K-space then ST is non-singular if arid only if S and Tare 
non-singular. If ST is non-singular, (hen (STf 1 - T~ l S ~ l . 

PROOF El" AT is non-singulai then ker ST = {0}. 

Bui ker T C kcrJST, thus ker T — {0} and T is non-siregular. By 
Theorem 4.12 it follows that 

rink (ST) - rank^ = ( K;A) 

ami by Theorem 4.11 S is also non-singular. 

If 5 anti T are non-singular then by Theorem 4.12 

rank ($T) = rankJ = {F; 

and by Theorem 4.| E, ST is rton'Singuiai, 

II ST is non-singular, then ST has a unique inverse (5T)~\ i.e, 

[ST) (Sly 1 - [ y . But, in addition, we have 

(5T)(r _1 J" ] ) = S(7T -1 )5‘* = l v 

and Lhua (JT)" 1 = 7"^ S~ l , I 

The concept of A r -isomorphism is of sufficient importance to 
deserve further aitention. 

if T V ^ W is a A-isomorpliisnt, then we have seen above that 
T -1 : Pis also a A'dsomorphtsm. Indeed AT-Jsomorphy is an 

equivalence relation on the %et of all AT-spaces. Clearly Y y V -* V is a 
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A-rsomorptnsir j]id if T ■ k r IVand S 1 IV U are A-isomorphisms 
then.57 ; V -*■ U is also a A'-isomorphism. In this case, we say dial rand 
If are A-isomoiphic and we denote this by V — IK A'-spaces which are 
A-is amorphic are regarded as being "’equal” or ”the same”, although 
they may contain different elements and the operations of addition 
and scalar multiplies it on are distinct. The reader may have noticed for 
example the similarity of the three examples (i) FOR), (ii> (R> r 
the R-space of real polynomials at" degree C, jl p (isi) M a {R), and that in 
practice they are dealt with in the same way. The isomorphism is 
easily established, for 

T : Pi (R) ** V 4 \ R) given by 

TT&o 4- ft t x + q,x 3 + a 3 x J ) - (oo, a u a 1f arj) 

is a R-isomorphism and 

S : Mi { R) -* Vi {R') given by 

sf“ ^ - ( 0 . 0 , ?.S) 

is also a R-isomorphism. We shall not deal with these examples in 
detail because the following more genetal theorem can be proved. 

THEOREM 4.14 Let V be a finite dimensional K-space of dimension 
ti, then V^ VJKl 

PROOF If (V ; K) - n, let {v u iij, ,.. , v n } be a A^basis for V, 

If it€ V then v — «! v t + - - + a n v n , wheret K{i — I.n| are 

uniquely determined. Then T : V V n (A') defined by 

7>i = r(a i Pi + ■ - * + % v A y = (a lN «!.<*J 

is a well-defined map which is easily shown to be a linear transformation 
over A, 7' is clearly a surjective map and since (V : A) = ( V H (A); A") = w.. 
it follows from Theorem 4.11 that T is a A-isomorphism, 

This theorem is a strong result if our goal had been to classify all 
finite dimensional vector spaces over a field A' then it tells us that every 
finite dimensional vector space over A is essentially a V n (K ) for some 
positive integer it. This suggests that rather than deal with an '’abstract”' 
A F -space it is only necessary to consider the "more concrete” V n (A), 
However, iti practice, it turns out that there are sometimes advantages 
in working ai the more abstract level - for example, simple and 
elegant proofs may be possible which may not be immediately apparent 
at the more concrete level. The detailed and sometimes cumbersome 
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explicit information available when more concrete vector spaces 
comprising vectors, matrices ot polynomials are considered may blind 
us from apprcaaiing what (lie bare essentials to carry through a certain 
proof may be. Rut, as is typical in mathematics, developments are 
usually made by exploiting the interplay between the abstract and 
concrete — when no more progress Is possible a I the abstract level, 
something may be done by considering an isomorphic concrete 
example or vice versa. 

It could be argued that a more elegant and natural In trod uct con to 
linear algebra would be to first consider abstract vector spaces and their 
linear transformations - develop their theory as far as possible and then 
introduce matrices and (he applications to linear equations. In this way. 
some of the more cumbersome and tedious proofs could be eliminated 
and the advantages of working at the abstract level would become mote 
apparent. However, the philosophy of our approach is that there are more 
be tie fits to be gained, especially to newcomers to the subject, by first 
working at the more concrete and familiar level and use this as a firm 
foundation from which the new abstract concepts can be introduced, 

In any ease T for explicit computations the woik in the earlier chapters 
will necessarily eventually have to be covered. 

The same is alio (rue relative to linear transformations and matrices. 

We have seen in §4,2. that every linear transformation can be 
represented by a matrix, but whereas the proof of the associativity of 
multiplication of linear transformations is trivial, the corresponding 
result for mutt tpli cat ion of married, although elementary, is cumbersome. 

A further Important isomorphism of A'-spaces is given as follows. 

Lei J/'iV, W) denote the set of all linear transformations of a 
A-space V into 3 Aspace ft'. [f5 t 7£ £XV, W) their sum $ + Tis 
defined by 

(.? + 7)0) = S(v) + 70) for all u6 V 

If ir, v' € R, or E A'„ then 

O' + T) {av + v ) = S{<XV 4- v ) + J’lpf? + V) 

- a S(v) + S{v} + aT(v) + T(v) 

= a{£+ DO) + (5 + DO') 

l *.s +- re %\v. wy 

Similarly, if a e K, S E V, W), define 

(ct5)O) = aS{v) for all i?G V 

then otS G ¥\v. W). 
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With these definitions of addition and scalar multiplication it can be 
proved that 

LEMMA4.15 Sf[V* W) is it Kspact. 

PROOF Exercise. 

if Kand W ate finite dimensional vector spaces, then the following 
important ^-isomorphism can be established. 

THEOREM 4.16 If V and W arc finite dimenshm! K‘spaces, where 
{V:K)=n, (W:K] = m then 

&W,W)^M^ n {K) 

PROOF If re Sf(v t HO and % = {v l7 .. * -»«}* ■#' = Jw- >'V J * J 
are Abases for V, W respectively, let (7} . = (oty) be the matrix of 
T relative to dSfand Jp\ Define <p : Sf(V, W)M m n (K) by 

(t~i ~ ^ ( T ) i 

If ttG K, S. T*= St'(V^ W) and V (S) ^ = <%) then 
H&T+S) = Iflotif+Pt,) - + 

since 

(or +S)v, - e (qq,, + 4 )w d (/— it.. ,n) 
f i=i 

i.e, is a linear transformation, 

d> is surjective, since by §4.2 we see that if A then there 

exists a r 4 € Sf(V r W )such that $(T A ) = A. Furthermore, if 
S. TG Sf(V, HO and (£} = 0(Jl, U. {4) - then 4 - 4 
{/ = 1n; / “ I t ,fl) and thus for/ - I. n 

m m 

Tv, = I «*«'( = 2 9*-», = SV) 

i=l f^l 

and so S = T f Le. <j> is injective and we have the required . 

A-isomorphism. " 

COROLL ARY // V and Ware finite dimensionalK-spaces where 
(V:K) = rt, < W:K) - m then i jt*{V, W):K) = mn. 

We have seen that in both Af^A) and 1 ') - Sf(V) in addition 

to the two operations of addition and scalar multiplication, the 
operation of "multiplication is also possible, it is of interest to see 
whether this operation is also preserved under the mapping to be 
more precise, if $, TG af(V\ is & (ST) = <b(S)^(T) or 
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(ST) 9 — {S)^ (T)^? Tliis is easily verified to be the case for if 
J#= ftfi,- v n } and 

T»j = £ 0 = l. n) 

f=i 

So i = 2 %®, (/=!.") 

/ = I 

Then (SD( K/ ) = s ( S V*<) 



and the (A ,;>dement of the matrix iST) v is E 4 . ^ , which is the 

{fr,/ 3 -element of the matrix (S)jg (T)#. 

The reader may have wondered when the matrix of a linear 
transformation was first introduced why one did not simply define the 
more natural. 

Tv i = E % v> (/= l ta .. 

/=! 

where the ordering of the i, f is preserved, j.e, the matrix is the 
transpose of the one defined in §4.2 . If this had been done, then we 
would now have obtained (ST\^ = {7}^ (J| # or $(ST) = 

(The ideas developed above can be expounded more succinctly as 
follows: A set together with, operations of addition, multiplication 
and scalar multiplication by dementi of a field A' is called a linear 
A'-algebra if 

(i) .✓is a A-space 

(ti) if a. b e .✓ thence .✓ 

(iii) {ab)c — a(be) t a(b + c) — ab + at, (a - 1 - ■= ac + be for all 

a,b y c G 

(iv) ofni?) = (aa) b = af atb) for all a t b G a € A', 

If .Vand. JuT' aie linear A-algebras then ..y'and ,.^ f are algebra- 
isomorphic if there exists a bijectlve mapping 0 : af _,r . ✓'such that 
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(i) (S forfl + & r ) = + $(a') 

for a ]6 a e AT, a,a‘E V 

(ii) tt>[ab) = o(a) $(b) 
for all a, b E sf. 

Then M„ fA") and J9f\V) are linear A'-algebras and if (V . A") — ra, then 
M n (fQ and V) are not only K -isomorphic but algebra-isomorphic, t 

Exercises 4.5 

1. If {P|, St, t? 3 , &*} is an R-basis for the vector apace V t for what value 
of \ ia the linear transformation T defined hy 

7 ^ l = + \V A 

Tty = 2v i _ l + v i (i=2 t 3,4) 
non-singular? 

2. If T ii the linear transformation on F*(R) defined by 

Tifti, tt 2 . a 3 ) = (3fli ^ofjpOfp — q 3 + Qj,—ai + 2 of^ — tscaJ 

show (hat T is non-singular. Give a rule for T ~ 1 like the one which 
defines T. 

3. A linear transformation on C regarded as R-space is defined by 
7T(f) ™ (1 — /}? for ill t E C, show that T is non-sign u la r. 

4. Prove that the differentiation transformation D on P n (Rl is singular. 
What does this imply for the kernel of D? 

5. If T is a linear transformation on V such that T" — 0, show that / — T 
is non-singular. 

46 Applications to Linear: Equations and the Rank of Matrices 

Let A = (etfj) E M m n (A ) and let e f {j = 1,... . , n | he the n columns of A , 

i.e. c, = (a,,. ia™ f . o^f). Then {fi.Cj.c n ) generates a subspace 

C A oiVJK), 

DBF ENITION 4.] 7 If A E M m H (K) the column rank of A is defined 
to be {C A : K) t or in other words, it is (he maximum number of linearly 
independent column vectors in A. 


US 


EXAMPLES 
1. Le i t I 

2 

A ~ j 

3 

\° 


-i 2 n 

0 3 I 

-13 2 

2 -3 -J / 


If C], Cj, C 3 and c A arc the columns of A and wc consider 
*i£l + a 7 c 2 + ft a c a + = 0 


then we have a system of tour linear homogeneous equations in the 
variables a*, a lK n 5 , at with matrix of coefficients A . It is easily shown 
that A is row equivalent to 

/< ° i J\ 

0 1 -J -J 

0 0 0 0 j 

\Q 0 0 0/ 

and thus 


from which, by putting % = J. = 0 and a 3 = 0, a 4 = 1 , we obtain 

£j = l(fj— 3c*}, = ifri”Fa) 

respectively, {c,. f a } is linearly independent over R and the column 
rank of ,4 b 2 , 

2. Find the column rank of the matrix 


j 2a + b 

2a + lb 

-a-2b 

2a + b 

3 b 

2b 

■“u + b 

if + 5 b 

2a 

4<j + 2b 

-3b 

2a 

\ h~a 

-2a-b 

3b 

2 b 


for all values of a and & 

From Theorem 3.13 we see that the columns of A are linearly 
independent if and only if del A 
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Now 


dt\A 


M 

3 

>3 

1 


3a + 3b 

-ta ~ 2b 

la + b 

0 


3b 

—a + b 

a -f 5b 

—a—Zb 


4a + 2b 

—3b 

3a 

a-fib 


-2a-b 

3 b 

3 b 


0 

ay 2b 

—a + b 

2 d 4- 4h 

(ah-2b) 

0 

3b 

-tj 

4 

u 

1 

a + 5b 

0 

2 a + b 

0 

3a + 3b 


l 

—2a “ b 

3b 

3b 


a —b 0 

a b 

3b I 

a y 5b 

la yb 0 

3a y 3b 


= {u -+ 2b) (a — hr 


I 

2a + b 


0 
u + 


= {a + 2&) 3 (<j - &) 2 

Thus, column rank /I =4 unless a - b or u = -2d, 
If a = b = 0 , then clearly column rank 4 = 0 , 

[fff = b ^Qi then 


(* 

Off 

-3a 

3a 

3° 

2a 

0 

■bra 

u 

6 a 

— 3a 

3a 

■\ 0 

-3u 

3a 

3a 


We note that t’j = c a r 2 and c* = 3cj — c 3 and if a V^O {fitCj} is 
linearly independent over 8 , that is, if a = b =£ 0 , column rank A -2. 
If a = —2b =£ G„ then 



-3b 

-3b 

0 

- 3i \ 

3b 

3b 

3* 

3b 

-6b 

—6 & 

— 3j^ 

-6b i 

3b 

3b 

3b 

W 
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and Ci - c 3 - c* and {C| P c 3 } is linearly independent over R, that is. 
column tank A = 2, 

Before proceeding, wt note ilui the row rank of A may be denned 
to he (lie maximum number or linearly independent row vedoir in A 
We show below that the row rank of a matrix is equal to the column 
mnk o(A, In the above example I , note that if the rows arc denoted by 
r i^ r i> r* respectively, thenr,~r, + /■*.* =r, — 2 r,, is 

linearly independent over R and so the row rank oM = 2 . 

If.4 = let T V n (K) - V m \K) be the linear 

transformation defined by 

T(x .= Oh,. yj 

where y ( = | a jc . </ = S . m). Then A is the matrix of T 

fi= i 

relative to the standard A-bascs for V n i,K) and V t JK) 

In the previous section, we defined the rank T, we can now prove 
the reassuring theorem that 

THEOREM 4.18 ftmfc T - column rank A. 

PROOF By definition, rank T = (im J ■ AT) 

If 

n 

On - - - *y m ) eimT,. then y i - v a (f x . (/=!,,_, m) 

}-Y 

or 

(Pi* ■ * ♦ *y m ) - ^ */ 'f a n/» °a/, - ♦ ■, 

Thus O'u - . v m ) la 3 linear combination of the columns of 4 and the 
columns of A generate im T over if. Hence rank T = column rank of A- 
as required. 

As a corollary' (o rTits theorem wc can now prove some important 
statements concerning the column tank of a matrix, 

t OROLLARY (i) A matrix A £ M ft (AT) £r invertible if and only if 
column rank A - n. 

C.ii.t If A £ M n (A r ) is imerttble, then the column ranks of A B, BA 
and B are equal, where B is any in-rawed matrix, 

The proof of (ii) uses Theorem 4.12. 
f urthermore we can prove 

THEQ RE, M 4. E 9 Row equivalent matrices ha Ve th e same column rank 
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PROOF If £? is row equivalent to A, then by Theorem 1.17 there 
exist elementary matrices E^E^ . E k such that 

li = EtEi , *„E k A 

But elementary matrices are invertible and so by (ii) above 

column rank of H — column rank oILd 

We can now prove that the row and column ranks of a matrix are equal. 
W'e first note 

THEOREM 4,20 If a matrix B is obtained from a matrix A by a 
single elementary row operation then 

row rank B = row rank A 

PROOF Tliis result follows immediately on consideration of the _ 
lluee types, of elementary row operations separately. 

COROLLARY Row equivalent matrices have the same row rank. 
Equivalent matrices have the same row rank. 

From this corollary and Theorem 4.13 we now obtain 

THLOREM 4,21 row rank A ~ eolumn rank A, 

PROOF Let R be the reduced echelon matrix of A. If R has r non-zero 
rows, then consideration of the form of A implies that 
row rank R = column rank R = r, Then, by the above corollary and _ 
Theorem 4.19. we have row rank A — column rank A - r. 

From now on we refer to the rink of a matrix only. 

Now consider the system of m linear equations in the n variables 
jc,,^ -x„. 

n 

£ X. = fl, (i = I f 2,. + , t m) 
i— i 

Then, by the above, we see that this represents the linear transformation 
T'VJK)^ ^(AT) defined by 

Tfifj,.. i,x n ) — 

We prove two theorems concerning the solution of linear equations. 

We first Consider the homogeneous case. 

T H FORE M 4,22 The solutions of the system of linear equations 
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I % x i ~ 0 £f=I. m) 

t-l 

form a vector space of dimension n-rank A, where A = (i.) e M m 
A non-trivial solution exists if and only if n > rank A , If ri - rank A, 
the trivial solution is the only solution 

PROOF In the above notation, finding a solution of the above system 

is equivalent to finding a v = (r tf x 3 .jr n )€ VjfC) such that Tv = 0 t 

i,e, pG k'(JC) is a solution if and only if ker T. Thus the solution 
space is ker T which is a subspace of But by Theorem 4.9 

rank T + nullity T = ( V n : K] = n 
and thus 

nullity T = n — rank T 
— n — rank A 

Hence, the system has a nontrivial solution if and only if 
n— rank 4 > 0 . 

I- n = rank A then ker T = {0} and the trivial solution is unique. 

We now consider the nun-homogeneous case, i.e. 

fT 

Z % x i = $ U = 1. m) 

/=! 

\ solution of this system exists if and only if (JJ,,, . . , 0 im T. But 
the columns of A generate im T, thus a solution exists if and only if 

Ij3i. & m ) is a linear combination of the columns of A. 

Lei {A\h} be the augmented matrix of,4L i.e. the matrix obtained by 
adjoining b — (|3 1t ... to the matrix >1 Then we can prove 

THEOREM 4.23 A solution of the system of linear equations 

E ™j t x i = 

/=! 

exists if and only if the rank (A \b) — rank A, 

?‘ROOF A solution of the system exists if and only if (j3 lt jjj,, .. ,fi m ) 

: a linear combination of the columns of .4, 

Thus, if a solution exists,, rank [A\b) = rank .4. Conversely, if 
■ink L4 I 6 | — rank A, then either b — 0 or b is a linear combination 
f The columns of A and so a solution exists, 
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The results of Theorem 4,22 and 42 3 should be compared with the 
criteria given for ube solution of linear equations in Chapter 1 . 

EXAMPLES 

I. Do the following systems of linear equations Jtave non-trivia] 

solutions? 

(!) X| 4- JjTj — * a -I- jc* = 0 (ii) x t + 2*j — = 0 

2*x — xj + jc 3 + x* = Q 2* i — jcj + x 3 = 0 

AT, — arjri-x 3 + 2jfj = 0 3jt t + x 2 + * 3 = 0 



Oeariy, the rank A C 3 < 4 and by Theorem 4 22 the system lias a 
non-trivial solution. 



11 0 0\ 

which is easily shown to be row equivalent to I 0 ] 0 L is. the 

\0 0 1 / 

rank 4—3 anti a pin by Theorem 4,22 the trivial solution is unique, 

2. Solve, If a solution exists, the system of linear equations 
X| + Xj— 2x3+ *4 + 3*5 = I 
2* i — Jfa + 2x 3 + 2x 4 + 6 a? - 2 
3*i + 2 je 3 — 4x 3 — 3* 4 - ^.v s = 3 
The augmented matrix is 



which is row equivalent to 


i\ o 

0 

0 

0 

l \ 

0 I 

“2 

0 

0 

0 ) 

\0 0 

0 

1 

3 

J 
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Since we dearly have in this ease that rank {A\b) — rank A a solution 
exists I by Tlieoreot 4.23 ). A solution is now found by the methods 
given in Chapter I, Le, from Hie above, we see that the system reduces to 

X! = 1 

*j-2*3 = 0 
*4 + 3*5 = 0 

and a general solution is of the form 

(l,2X ( k-3M^) = (1.0.0.0,0) + A(0,2 1 l p 0 1 0) + M<0,0 1 tl,-3,i;i 


3, For the system of linear equations 


X t + *J + 1*3 + *4 = 5 
2*i + 3 xj - x a — 2*4 = 2 
4x t + 5*j + 3* a —7 

the augmented matrix ts 

/ 1 I 2 1 

U|fi) = 2 3 -1 -2 

\ 4 5 3 0 


5 

2 

7 


*hich is row equivalent to 


( 10 7 5 

0 15-4 

0 0 0 0 


13 

8 

-S 


which implies that rank (j 4|^> > rank A and so the system dues not 
nave a solution. 


Exercises 4,6 

1 Show that the rank of the matrix 


<-V& vs vs \ 

I V® -VS 

I -yfb 


1 2 5 













2, Find ihe rank of the following matrices for all values of a 


(i)/l 

3 

5 

6 + o \ 

m 

■ 

J — 2a 

l 

l — 2a 


z 

3 

4 — a 

2 

1 

l+2a —1—a 

-1 +2tr 

J -a 


i 

1 -a “2 

“ 5 


2-a 

3 a 

la 

2 -a 


\i 

6 

n 

19 j 


\ SjT 

\ —a 

1 + 3d 

0 


3, Show that the rank of (he matrix 
/ 


a 

b 

b 

a 

b 

a 

—a 

-b 

a 4- b 

a + b 

2a 

—2a 

,- 2 a 

2a 

a + b 

a + b 


is 4 unless a + b = 0 or£ = 3a. Find the rank in each of these cases. 

4, Find all values of r for which the matrix 

'(l+f)f t— I —t 

0 2 “I 

-It 4-2 1 t — 2f 

is of rank less than 3 and determine the correspond mg rank. In each 
case express one of the columns as a linear combination of the others. 


5. Find the rank of the linear transformation defined in Exercises 4 . 2 , 
No, 7 for all values of a. @ and 7 . 


Lei S £ ,'W n fA r | he fixed and 7"be the linear transformation on 
{K) defined by T(A\ = .4S. If S is an invertible matrix, show that 
rank T-n 1 , In general, prove that rank T = ft rank 5. 


CHAPTER 5 


Inner Product Spaces 


5.1 Introduction and Three-Dimensional Geometry 

In Chapter III, vector spaces over any field were defined as generalizations 
of 2 - and 3 -dimensional real spaces and many of the basic concepts in these 
cases were extended to vector spaces in general, e.g, Agasis, linear trans¬ 
formation etc. But there arc ill addition, further concepts which prove to 
he useful in these cases, namely the length of a line, angle between two 
lines, perpendicular tines, etc. This chapter will consider the generalization 
of these ideas to vector spaces over the real and complex fields. Before 
consider Lug this genera li ration, wc shall review these concepts in 3-space 

VA&l 

Let V- (cr.ft y)£ ^(K), then Tefering to Figure 1, the length nf v, 
which is denoted by ||n| is 

[Ml = >/QR* + PR' 

= + QR 2 + PR 7 

- y/a 1 + (3 s + y 

where \f~ means the positive square root. 

Note that if X ■£ R then 

UX*|| = IX I Ill'll 

since ]| \v\\ = yf\H& + P + 7 ^ 

= IXIIItfll 

:«£ T 3 (Ri is called a unit vector if It?II = 1 For example, 

(l. 0 . 0 ). ( 0 , 1 , OHO, 0.1). (Jf. 0 ) . jf. Tf) »« uni. 

1 

vectors in If tft RjfRl then 7 — 7 . -uis a unit vector, 
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be the angles which OP makes with rhe x-, y- and z*axe 5 . 
respectively, then cos <? = |2 = ^ _ CM ^ = X, C(B * = .X 

d, cos $ and cos 0 are called the direction cosines of p, 

Now, Jet v and w be two vectors in FjtR), represented by the points 
P and Q respectively, see Fig, 2 „ 


i 



I he distance bet Ween/* and Q. denoted by d (P t Q\ or (he length o ( PQ 
3S equal to the length of OB\ where P' is the point 
Cs-fi i\p-0\ 7 -y r ). Thus 


i:g 


_ 


i(P. Q) = ll(o - a', |3 — y — v')ll 

= V(n.-«') 1 + 03“p'> J + (T->'y ! 
= If®— w\\ 


The angle between v and w is defined to be- the angle POQ = 0 such 
that 0 < 9 < ?r, Now. by the cosine rule 

PQ 3 = OP 2 + QQ 2 — 2 .OP.QQ cos 9 

that is, 

_ 11^— wll a — Hul| a — tl^ll 3 

—2 fltdl M *v|| 

= (a — a 1 ) 3 + tf — JV * *■ j3 3 * 7 a + g ra + V 3 ) 

~2 fl*llw| 

= w+ffl' + ri 

iitfir n wn 

If t 1 — (a, fr, y), w — (or r , JJ’. 7 ^, (hen the inner product (or dot product) 
of if and w. denoted by (tf, w) (or if. w) is defined by 

(v, w) = act' + flf' + yY 

In that case, from the above, we have 


(P, w) = I|P|| llivlf cos 9 

which is sometimes given as the definition of inner product Note also 

to if pit = v&). 

Two vectors tf and w are perpendicular or orthogonal if cos 0 = 0 
or (u, w) = 0. For example ( 1 , 0 , 0), ( 0 , 1 , 0 ), ( 0 . 0 , I} are mutually 

perpendicular, Also jj) arc perpendicular 

to each other. 

In physical applications the vectors ( 1 , 0 , 0 ), ( 0 , I,, 0 ) and ( 0 , 0 , I) 
ire denoted by i, j, and k. respectively and us we saw in Chapter III, 

■! 3 j. Jc) is the standard R-basis for F 3 ( R|. Thus, F 5 (R) has an R basis 
consisting of vectors which are mutually perpendicular or orthogonal, 

T ms is the foundation for the Cartesian coordinate system which is of 
fundamental importance in the development of geometry. In the next 
section, having generalized the concept of orthogonal vectors to 
xbitrary vector space, we shall show that every tcuI and complex 
finite dimensional vector space has a basis consisting of orthogonal 


sectors. 
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The tallowing theorem can be proved concerning the inner product 
THEOREM S. 3 If u r V, w t t'' 3 (R) and X € R then 

<i) (u + V, w) — (u, w) + (n w) 

(ii> w}=\{v, w) 

(iii) (v, w) = (h 1 , t?> 

(iv) (v r v) > 0 if v # ft 

PROOF The ptoot is elementary, for example 
if v = (cr, j3, >), '} then 

(Xv,w) = + ^ + 

= Ata£/+flj’+ r) /} 

proving (ij). a-* + $" + y 3 > 0 with dc, (3 P ■>€ R if and only if at least 
one ofa ,0 or 7 is non-zero, that ii (a, 0 , T) * ( 0 t 0 d 0 ), which proves {iv ) I 

When vector spaces were first defined in Chapter 3, the basic properties 
verified in the special case V n {K) were taken as motivation tar (lie 
definition of abstract vector spaces. For the new concepts which are to 
be introduced now, it h the properties of the inner product eruincraietf 
in Theorem 5,1 which ate crucial to make things work. Thus, we again 
reverse the process and take the statements in Theorem 5.1 as the basis 
os definition of inner product spaces, given in (he next section, 

Attention is restricted to the case where the field K is a real or complex 
rleld (or their subfields), Statement (iv) will only be meaning fill if {v, v) 
takes values in an ordered field such as the real field. By modifying the 
requirement (iii), this can also be assured when K is the complex field. 

It would he possible to develop the theory of vector spaces over an 
arbitrary field with a symmetric inner product, i.e, an inner product 
satisfying (i) r Hi) and (sir) but jr w® be seen that (iv) is absolutely 
essentia] if the crucial concepts of the length of a vector, distance 
between points, the angle between two vectors and perpendicular or 
orthogonal vectors are to be genera I lied. 

Exercises 5 .I 

1 . Which of the foil owing pairs of vectors are perpendicular'’ 

(S) ( 2 ,- 1 , I) and 11 , 2 . 1 ) 

(ii) (2. 1,-3) and (1,1,1) 

(iii) (7,5*3) and ( 1 ,- 2 , 3 ). 

2, Find a vector ocrpendieular to (2. —I, 2) and (1, — 3, 2). 
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Find the lengths of the tallowing vectors 
00(1.2,1-)* (0) (3,-2,5), (ill) (1,0,—1)* 

4. Find the angle between the tallowing pairs of vectors 
(i)(3,-2,l) mi <1.-1,1) 

(fi) (2,1-1) and (1.0.2). 

5.2 Euclidean and Unitary Spaces 

Throughout this section K will stand for cither the field of real numbers 
R Or the field of complex numbers C and V a A'-space. 

Dl:l [NlTEON 5,2 An inner product an V in a fufiction which assigns 
to each ordered pair of vectors u, v t V a scalar (u s v) <= K with the 
folfowing prop ernes 

(i) (u + w, p) - (u, z?) + (w* v ) for ail 

(ii) (etz/, p) = a(u, v)for ail u, fG V, a G K 

(iii) (v, u) — (u, v), for atJ u.v^V 

(iv) {% p) > 0 ifv± 0, 

where the bar denotes raking the complex conjugate. A vector space V 
with inner product is called an inner product space. In particular, a real 
inner product space is called a tu did fan space and a complex inner 
product space is called a unitary space. 

Before looking at examples, we note that (i), (ii) and (iii) imply that 

(on + £hv, ii) = a(u. u) 4- j3(w, i?) 

and 

{u, ctv 4- |3w) - 4(tr, If) + $(w, w) 

for all a, $ € K. u r fr, w € V, since 


(a w + pw, if) 

= (tt2i K P) + 

W”* v ) 

by 

(0 


+ 

_a 

II 

J3(w,p) 

by 

(ii) 

(u, tt E? + j3w) 

- (at? + j9w 

rtf) 

by 

(iii) 


= Q(P, W) 4" 

(l (w, u) 

by 

the above 


= a(u,v) + 

J(u, w) 

by 

(iii). 


Note also that (iii) ensures that {v t v) £ H and so I iv) is a meaningful 
statement. 
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EXAMPLES 

1. If a = ..a„), v = (0u ft,-jy € V n <R), define 

(w> v) = a s 3, + ftj $ 2 + . .. + a n $ n 

then it is easily shown that this is an inner product on V H {R ) and thus 
L tj <R) is a Euclidean space. TJiis is a naiuiai generalization of the inner 
product on F a (R) considered m Section 1 . and will be called the 
standard inner product on 

2. If tr = (q u a a ,.<g. P = tfi, ft,.., f Jy £ VjC), define 

(“. p) = ttt fli + + ■ ■ ■ + □„ § n 

[hen again it a easily shown that 1^(0 is an inner product space and 
thus a unitary space, This will be called Lhe standard inner product on 

MP- 

3- If/, g e C [a r h], define 
if*E) = I dr 

U 

then (i)-(ivl in Definilion 5,2 are familiar properties of integration. 

This will be called the standard inner product on C[$ f b ], 

4, If a - (A h a,, .. t at n ) r v = (j3 |p „ ± 0 J 6 V n ( R), define 

{Wi *0 = Q ]01 +■ 2 ftj fJj + , „.. + n& n <J n 
then it is. a pin easily verified that this also defines an inner product on 

*iW- 

From now on in Hus chapter K will denote an inner product space. 

DLflNITI ON S 3 The length or nvrm of vEV denoted Ay|[fJ[ is 

defined by 

Hull 1 = ^/(p. v) 

A vector v e V with |Ju |j = / is allied c unit vector, 

Note that by Definition 5.2 (Iv) if v & 0 (p, jr) > 0 and so \'(y. v) 

is a positive real number. Also if ir £ V, r fQ then -I ■■ v b a unit vector 
we say that tire vector v has been normalized. ■ v ^ 

in the ease of ^(R). tills is clearly a generalization of length in 
VjtR) considered in §5J. In ^(C),if = (a,. flr* + V n (C), 

then 


{V. V) = Oi a, + Bjtta + .. * + a H a H 

- IttiP + loiP+^.+ l^l 1 

The next theorem shows that the length of a vector has some of the 
familiar properties of (he length of a line in the plane or in 3-space. 

THEOREM 5 4 Ifu t vBVand tt£ K r then 

(i) [|oif|= |at|llc|L 
(il) l|t?|| >Qifv±Q, 

(hi) |(u r u)I ClluII Hull 

(iv) ||if + «J<||u|| + |v|. 

PROOF (i) Haul | = (au.av)* 

= (an(v, v»* 

= let I IHl- 

(ii) follows immediately from (iv) of Definition 5,2, 

(iii) if u = 0 P then both sides are t) and the result holds. 

If i 4 ^ 0 , put w = v — V u , then 
II if II 

(w,u) = (?,«)- 
= 0 


and 


0 <|jw|| 3 = (w,w) 


that is 


= (*^J 


= U 


Hiri r 


l(ti, u)l 5 < Hull 2 lit? II' 


i(u,v)i<iiujr iiuii 
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(rv) Now, by means of (ui> above, we have 

1 u + tJ H ; “ (u+v,u±v} = (lufl’+fw^ + foKj+fltfrl* 

< M a + |(ti fc ^4foir)| + \\v\l 1 

^ fl^ll 3 4 !Ca 1 v)| + |{B t H)| + Jl!?j| 3 

< JlalP + IllulJlj^K + dtfll 1 

“ (flail + IIyII ) 1 

and hence 

||a+tj|<l[li|| + i|p|| | 

<iii| is called the Cauchy-Sdiwart inequality and is a generalization 
of familiar inequalities in other set ling* as we see below and fjv) is 
called the triangle inequality, for in l 3 (R) it reduces to the well-known 
statement that the length of a side of a triangle is less than the sum of 
the other two sides as is seen in Fig. 3. 



Alternatively, we define 
£l(«, d) - \\v-u]\ 

' 0r ^ u - " L '^ V . and call d( 2 /„ vj the distance between u and tr. Then we 
have an alternative version of the tnangle inequality. 

COROLLARY ffu. v. w E Vthen 

i{«, kv)<d(b, V) + d(p. Hr) 

PROOF Replace u and v fn (tv) above by v — u and w — v 
respectively, then u + r is replaced by w u and the statement {jv> of 
Theorem 5,4 nuw becomes 

d({i, + d{v,w\ 


134 


_ 


In V n t R) anti f^fC) with standard inner products (iii) becomes 
+ «»fc + - ■ • + zjj < («.’ +Oi ! + . ■ • + «„ ’! 

and 


l(aift + a 1 0 3 +.. , + o rt 0 n )P 

respectively. These two statements (the first is obviously a special case 
of the second) are called the Cauchy inequalities. 

In ,C[a,b] with the standard inner product, (iii) becomes 


( / fU i gin dr) 3 < (V' f{f) 2 dr) ff gU'f dr ) 


which tn is an important property of integration. 


The concept of angle can also be introduced for real Euclidean 
spaces V. If u, pE V, then by Theorem 5.4 (iii), wc have 


l(u,n)| 

In|! Ilf | 


< 1 


or, what is [he same, 


-1 *£ 


m iivn 


l 


and (h, tr)/|]u|| II p |! is a real number. The angle d between u and v is 
then defined to be that number 0 <#< v such that 


cos 0 = 


IHllvli 


what has been said above ensuring that 6 is well defined and also [hat 
this definition is meaningful, i.c. cos 0 is a real number and 
— I *£ cds 8 < I for all angles 0. It is clear that th is definition of angle 
cannot be extended to unitary spaces. If fl = ff/2. then («, t') - 0 and 
we say (hat u and V are orthogonal Or perpendicular to each other. 

This will he subject of the next section, since (he statement 

J tu, tr) - 0 " is meaningful for unitary spaces also, the concept of 

orthogonal vectors can be introduced for arbitrary inner product spaces. 


135 














EXAMPLE 


In V t (R) with standard inner product, if u = (3, -2, —3 , I, ], - I), 
v = (—1.0,0, 1,1,1), find ilie lengths of u and uand the angle between 
u and v. Verify (Iv) of Theorem 5.4 in this case. 

By Definition 5.3, we have 

Hull 3 = (u, u) = 9+4+9+1+I+1 = 25 

Hull 3 = [v,v) = I + I + I + 1 =4 

thus ||ul| = 5, ||fit = 2, 

The angle I? between u and Pis given by 


thusfl-cw " 1 (-1/5)(fe 101*34') u+ * = (2,-2, -3, 2. 2,0) and thus 
llw + u|| = sA’+ 4 + 9 + 4 + 4 = yfli <2+5 = ||u|| + |fp|| 


Exercises 5.2 

1. Which of the following are inner products on J>jl R|, if u - (aj,,a 2 )i 

(i) (u, ir) = aj|3| — a 3 jS, — a,0 3 + 2a 3 |J 2 

(iij (u, ®) =* QiUi + «i0i +n,JJ 3 -a 3 S 2 

(iii) (u, v\ = +u,^+ 2 tt 3 dj 

fiv) (u,v) + 

2. Which of the following are inner products on P^fR), if 

(i I (u, if) — cr L j3| + 20jl? ; + 3&3,fJ 3 + fti/Jj + rv 2 ^| + a, JJ a 

+ tt 3 0 t + 2a, ^ + 2q»& 

(ii) (M, m = or,jJ, + + 3ajflj + 2a,da + 2n t f} 3 + 4<* a (S, 

OT (u,t^ = o,/J t +a a /Jj - Gj0i~ «idi tt a ff t 

+ ojUj + a 3 j3 ;j 

3. Which of the following are inner products on C[l, —1 j. the vector 
space of real valued continuous functions defined on [ 1,1] if 
f>g&C[ 1,-1]? 

(1) (Is) = / ( /tvhel*) ±V 
(iij if,s) = /_' 3 (l -jr ! l/(jr)f(.t) dt 

(hi) CT.g) = /_ L ( x*f{x)g(x) dx. 


4. Which of the following arc inner products on M rt \ R i, if-4, B i R h 

(j) {A+ B) - trace (AB) 

(i3) iA>B) = <tet(Afl). 

5. Compute Hull, Hvll, Ifu + Ull, (u. tf) and the angle between u and v 
and verify that the Cauchy-Schwarz and Triangle Inequalities hold if 

(i) u = (I t 0 , 2 , ~2) and v- ( 2 , 1 , - 2 , 0 ) are elements of ^(Ri 
with standard inner product- 

In) u = (1,0, 2) and u - [2, 1, 2) are elements of V % { R \ for the 
inner products defined In Exercise 2 above. 

(iij) u — x and v - cos nx ire elements of C [0, l ] with the 
standard inner product, 

6 , If V is a Euclidean space and u, uG V prove that 

(i) llail-llt'ilKIltt-^l 

(ii) Mu, v) - Hm 4- 1 > || 2 - ilu - tf|| a 

(iii) ||M-tfll J + ||w + vJr a = 2 (M 1 +||lJ|| J > 

What does (iii) say about the diagonals of a parallelogram",' 

7, If u, it<= V t show that she distance function d(«, tr) satisfies 

(i) d(u + u) > 0 

(ii) d(u, ti) = d(u, h> 

(iii) d(«, tf) = 0 if and only if u = v. 


5J Orthogonal Vectors 

Lei t- r be an Inner product space. 

DEFINITION 5.5 tf u, yS Varid [u. P) = 0 then u and rare wid to 
hr orthogonal {or perpendicular) s,:> each other A subset S of V is 
culled an orthogonal set if the dements of S are mutually orthogonal. 
A n 'rthogimai set is called an orthonorma! set if each vector has unit 
length Le, ||t?j| = /. 

EXAMPLES 

In F^fR) with standard mneT product, find the vectors orthogonal 

If u = (a, r n 3 , n Sl rt,, V t { R) is orthogonal to V then 

3a t — 2fij — 3cf S + Di^ + a s — a 6 = 0 

that is, the set of ail vectors u orthugonal tt> v is given by all the 
solutions to this linear equation. 
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nearly {(3 p O t 0, 0, 0.3),{Q , I r 0, 0,0. -2), (0, 0, I.O.O.-Jl 

(0,0,0,1,0, 1),(0,0,0.0, M)} 

is an R-basis for the solution space to this lineal equation and ali 
R-linear combloations of these vectors are orthogonal to v. 

2. Che standard bases for V n (R) and fCj are orthunarmal relative 
to the standard in net product. 

3 In C[l, -If, prove that {F 0 (jr) = 1 , P L (x) = x,f t {x) = I)} 

is an orthogonal set of vectors. Find the length of each element, 


P, {*)) = j x6x = 


x 

L 2 J 


1 -I-I-o 


<?»(*), ftt*)) « J^S^-Ddx = [| 


A JL 

3 


ni — A — J.+.l = o 
2 2 2 2 T 


KWAMI = | _ , [ 4*(3jr , -l)dt= [‘“^l' 


= i-i-l+i = o 

« 4 8 4 


(p„(*),r 0 M) = ; j d* = Mi, = 1 + 1 = 2 , 


(Fi(*),Pi(je» = / x J ds- = 


X 3 ] J 1 

3L 5 


= ^ + i e l 

‘ 3 3" 


»«**«> - 5 $**- lr* = +^* 


1 

J-i 


2 

r 


thus P 0 (jr), F, (x) and P 2 lx) have lengths yT, and J^r 
respectively, 


LEMMA 5.6 ,4 orthogonal set of non-zero vectors in on inner 

product space V is linearly independent. 

PROOF Lei i]rj, . . . * be an orthogonal set of non-zero 
vectors in V. Consider 


a t i?j +ajPj + .. . + \v a = 0 

where a f €E K (i — 1,2,, , „ „ n), Then for I ^ K 


IBS 


0 = (i a f Vt'%) * $ 

M“1 / |=I 


= MW 

and since v k # 0 , (v k , v k } =# 0 and so 0 ^ = 0 . _ 

Thus {y h i? lr „.., v n ] is linearly independent over K. 

We now prove our main result which sllow 5 that every finite 
dimensional inner product space has a basis consisting of orthonormal 
vectors. Furthermore, the proof is constructive in that it gives a 
procedure for determining ati orthcmormal basis from any given basis 
for V. 

TlIEOREM 5.7 \GramSehmfdt Qrthogo/taliLotion Procedure ), 

Every finite dimensional inner product space has a basis consisting of 
arthonorrmii vectors, 

PROOF Let {t?,. »j T .,. , i^} be a A r -basis for the inner product 
space V, Define the subset {t/ a , u a , . , , , u n j of V inductively as follows 


u ] = Cj 


u 3 = v 2 ~ "iV 
U«ill 

3 3 KF 1 (ff 1 


W PL 


l' ~ 


[ it-'.!J . Ujq „ | ) 

IgTTF 


. ^-"i) 

ii«7r 




that is, the coefficient of u. in / < i is the inner product of v ( with u / 
divided by the length of u^ 

Then u,. r/. 2l rT n n . are non-zero, otherwise we contradict the Linear 

independence of {v t .. We show that iU| f u 3 ,,,., is 

orthogonal by induction on r\. If/t = 2, then 


md soi fill, n 2 } is an orthogonal set. 

If n > 2, assume that {w i, u 2 . u n ^,} Is an orthogonal set. To show 

that {Wi, u ls _ u H } is an orthogonal set, we must show that 

a„ T u f ) = 0 {i = l, 2 t v. - , n — 1). Mow, fori = 1,2. . . . , n — 1, we 
Live by the induction assumption that 
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= («*,«,.) 
= 0 


_ *<) 
lfu,|l ! 


as required. 

F urthermore, by the previous lemma, |w lp w 3t _ t w n } is linearly 

independent over A' and so is a A'-basis for V Now, pul 

w i = ij^ - ] u i V - I * 2 t ..., ft) and each is a unit vector and 

l^i. wi* - ■ ■, w w } ls an orthonormal basis for V. 

In §5.2, Example 2 we defined the standard inner produel on JjCj 
we now show that every inner product on a finite dimensional inmr 
product space essentially takes this form. 

Ft E is a finite dimensional inner product space then by the above 
theorem it has a K+btw p u tr 2i H .., v n \ consisting of orthonoimal 

vectors. If u, V then u = E a t v., p = E ^v f {a ir j3, £ A r \ and 

(—1 f-i 


(U.t?) - ( £ P ft T ft V f ) 

\i-l 1 = 3 / 


= 2 

U=i 


= X 

1-1 

since (v it v f .} = ^{i,j= 1,2,.*), 

examples 

E, Apply the Gram-Schmidt orthogonal Nation procedure tu the 
vectors. zr t * (I s 0. I), ^ = (I,0, -I), fc, = (0,3,4) (o obtain an 
Ofthornarmal basis for F 3 fR). 

Put 

“i = Vt = (LO, I) 

1*7 = Vi - (1,0,-I) 


HO 


u ? = t ) 3 - 






rv, 


= (0,3,4) - L^'ll.O.-II-jd.O.I) 

= (0,3,0) 

then (u,. ir 3 , e/j 1 is an orthogonal set* The lengths of these vectors are 
y'X \/2", 3 respectively so the required R-ba&is for f^iR) is 

f ^(1,0, l),^<l,O,-l),(0, 1,0) . 


2. Extend the orlhonorma! set 14(2, 0, —1,2), 4(2, l, 0, —2)} to give 
an orthonoimal basis for K,(R). It is dear that the set 
{t>, = 1(2,0^1,21^ =4(2, l 1 0,-2),i4 = n,0,0.0) 1 
t' 4 - (0,0,0, 1)} is an R-basis for Fi(R). Pu! 


uii — P 3 

u 3 “ v 2 


«s = tib 


£hj^s) 


u 7 




= (1.0.0,0)- f , 4(2.1,0,-2) —1 . 1(2,0,—1,2) 

- J(l,-2,2,0) 


r/ 4 = V, — f tf, 

,1* i,j I 


W' u >) 


u, 


= (0,0,0, l)-0-{-i). J(2,1,0, —2) — |. i(2,0, —I, I) 


- <o.S,U) 

After normalizing these vectors we find that 

(i(2,0,-1, 2), )(2, l, 0,-2). i (1,-2,2.0), i(0,2,2,1)} 

is the required orthonarmal basis. 

3. Let V be the subspace of real polynomials of degree < 3 in C(l, — 1J. 
Find an, orthonurmal basts for V. 


{/p = 1 ,/| = x, ft = x* r / a = x 3 } is an R-basis for V. 

By the Gram-Schmidi Orihogonatization Procedure we obtain ar 
orthogonal set of vectors f guSir 8 s) as follows: 


14E 


























So “ /* — I 

£r 

(foyJo)' 


* l - /i”- 


J- iXtix 
fhte ' 


= j 


Si 


= h~ 


</i> f]) _ C/i. go) . 


/Jj* 3 dx 

— jr ■---- i 

L\^±x /J, Ax 


= i(3* a -i) 


^3 = 


/ 3 


l/W?) _ (/lngl) _ (/]uIo) _ 

fauS* 1 fri^r 1 


j /-i 4 f- 3 * 2 “ I)d* . , J l . * 4 dx 

/J, x J d* 

- —-j 

/i ^ 

= J{5x 3 -3j) 

To aormilh* these elements, we note that 

teo,So) = 2, tej.fi) = j ( (£ 2 ,£ a J = 

= T^¥ 

and the required orthonormal basis is 


TTio.'i-e polynomials are the 11 r s t lour of the Legendre polynomials wlilch 
aru impor l ant in analysis. For further information on these and other 
applications of inner product spaces in analysis. e.g. Fourier scries, see 
D, L, Kretder, H.C. Kuller, D.R. Ostbcrg and F,W, Perkins {joe. cit ,) 

Ex&cises 5.3 

(Unless otherwise stated the inner products are the standard inner 
products,) 
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1 , Show that each of the following pairs of vectors are orthogonal 

(i) (2,3,-2, i,Q h l) and (2,-1, .1,0 K 3U)in Fi(R) 

(11) tt 1,-0 and (1 - (,2 , I + 1 ) In Vj(C) 

(Lai) J and cos wx in C[ 0 , 1 j. 

2 , Find all vectors which ate orthogonal to the following 

(i) (-1,1,2*—l)inn(R) 

(ii) (1-/J +0in ^(C) 

3 , In C[(J. U prove that ccslmirx and cos2fflrc (m n) ate orthogonal 
and find a quadratic polynomial orthogonal to I andx Furthermore, 
find the length of cos mux and find a necessary and sufficient condition 
for a + bx and c + dx to be orthogonal in C(0,1 ], 

4, Show that sinTTje, sin 2iw, . -. , sinmrx are orthogonal in C[ 0 , 1 J. 
Obtain an orthonormal seE of functions from these. 

5, Use the Gram-Schmidt Orthogonaliz alien Procedure to 
orthogonal isc 

(i) 1(1, -1.1),(2,1,1), (1,0,1)> in r 3 (R) 

(ii) {(1,-1.1,1).(0,1,0,1),(2,-1,1,1)} in r„(R) 

(ill) {(1,-1./),(!. 1,2)1 in ViiC). 

G, Complete to an orthonormal basis 

( i) j ^ ^ T (0* I , 0) 1 O f f J ( H- I 

(ii) i.i}.4&\U.i)} WQ- 

7 . Find orthonormal bases for U 3 (R) for the maps in Exercise 2 in 
§5-2 which arc inner products, 

g, Lei V be the subspace of C[0, I) containing real polynomials of 
depee at most 3 . Apply the Gram-Schmidt Orthogu realization 
Procedure to the R-basis {l .r.r 1 , x 3 ) for K 

9. If j£ ln Uj,„ *., is an orthonormal basis for an inner product 
space V. prove that every tr€ I r can be expressed as 

rT 

V = £ («. V t ) 

1 = 1 

(i) Find an orthonormal basis fur 1 3< 0 > and find the co-ordinates 
of {1, i, —1) relative to this basis: 

(ji) Find an orthonormal basis for the subspace of CIO, ! J 
consisting of polynomials of degree at most 1 and find the co-ordinates 
of x 5 + t andx J — x + 1 relative to this basis. 
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10. Apply the Gram-Sellmidi Orthagonalization Procedure (o (he 
R-bjsi5 {]. x, jr J , r 3 J fur /MR) where the inner product is defined by 

/' u-jf'J/MrMit 

11. Let V be a finite dimension a I inner product space with orthonormal 
basis M- f P], . r , ,p^,) and T a linear transfer nut ion on K Prove that 

cn* = (i^, vj). 

12. If V is a Euclidean space and ti, -pe V are such that f|u fl “Ilf lb 
prove lhat n - P is orthogonal to n + v, What does this say about the 
diagonals of a rhombus? 

5.4 Application to the Rank of a Matrix 

In order to apply the above to prove that the column rank of a matrix 
is equal to its row rank we need first to introduce some additional 
concepts. For the first part of this section, let I'be an arbitrary A'-space. 

DEFINITION 5.8 iff V ,/nd ft-' be sabs paces of V , then T is called 
the direct sum of U and W, written V - U a W if 

(i) r**tf+w 

i ii l every element V of V can be uniquely expressed as v — u 4 w, 
where u £ U r w E [V! 

The first lemma gives an alternative criterion for V to be the direct 
sum of and W. 

L EM M A 5,9 if V - U + tV then I' = U * IP if and only if U r\ ty = { 0 ■. 
PROOF If p€ ii n w then v e it and v e W tben 
s = p + 0 = 0 + p 

and since V = V s h\ v = 0 and V nii-' = f 0 /, 

Conversely, assume that U n W = {0}. 

If i?€ W, suppose that o = u t + w t = u t + w 3l where u u u, E U, w lt 
w 3 E tV arc (wo expressions for ic, then u, u 3 = w t — w, E f/n W 
and a, = w 3l iv, - w 3 and the above expression for i 1 is unique. 

Lf ^ MA 5.10 if V is a finite dimensional K-space and V is a sub space 
of V, then there exists a sab space W of V such that 

V = U © W 


and (V A) = (U; K) + (IV: A) 
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PROOF If fp lf , ». , , is a Af-basis for U, extend this basis to give 
a A-basis f V\ r . . .. v m , v m _ i , -, r f P H | foi IL et W be she sub-space 

generated by {t 1 ^_,. v n \, then it follows that t' = U ® IV and , 

{ V : A} = (£/: A) + (tv: A'). I 

From now on, let V he an inner product space. 

[Mr F( N1TI0N 5.11 if S is a subset of V, the orthogonal complement 

S 1 = (jr e V\fa j} = 0 for sU $ e S }. 

LEMMA 5.12 ifS is a subset of V, S 1 is a subspace of V. 

PROOF S ' is nun-empiy since 0 S& 1 , 

If u, t?6S\ a £A\ then 

(iku + v, s) — a(« n s) + (fl, J) = 0 for all sES 

and so au + t?G S ' and J 1 is a subspace of V. 

THEOREM 5.13 Let ft be a subspace of a finite dimensional inner 

product space V r then 

V = w& W L 


PROOF We can dearly assume that W ^ f 01 and IV *■ V. If 
f V :fC)-n and (IV: ^f) “ r < n then by Theorem 5.7 IP has an 
orthonurmal basis w 2 . r . . , w r }. Extend this to give a A-basis 

{ w u . , ., W r , Vf+i. _ T V h } for V. Applying the Gram-Schmidl 

orihogonahiation procedjrt to this A^basis will give an orthonormal 
basis (w t ,.. „, + ,. f }■ for V. We show that fw r+1 ,., „ , w,,} is a 

A'«basis for W L . If W\ then V and J q ; w r IF 1 <i<r 


then 0 = (v, wj - ^ a f w fw w t j = 


r=l 


— and v = I w r i.e. 




{w r ± v r . -, wj generates W\ 

Conversely, every A’-linear combination ot" . ►. , is in IV L 

and thus {w f + tt ..., w^] is a A’basis for and by Lemma 5.9 

V « IPs W 1 


We now apply this to the solution of a system of linear equations. 
Consider the system of linear equations 


2 *1/ x i 0 

yiii ' 


ii= 1,2. m) 
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If A = {cy r ) e M mn {K} and x ^ (jt t , x 2 , ■ - -, *„) then tilts system may 
be represented in matrix form as 

Ax' = 0 

Now let r f = (c^ |F a /lf . ■ - , ~ l,2 t . , . ( m],thefi this 

ay stem can also be represented as 

(r s *x) « 0 (i»1,2, ♦,.. m) 

bet R a be the subspace of V n (K) generated by *,.„ r^}, 

Titus the lolutlon space of the system is R^. 

But. by Theorem 5,33 

VJK) = R A *RJi 

and the dimension of the solution space = (7f^ \K) -n— (R A ; A"), 
where (R A : K) is the row rank of A . However, by Theorem 4.22, the 
dimension of the solution space is n-column rank of A, Thus, we have 
proved 

THEOREM 5,14 If A <= M m n (K) then the row rank of A is equal to 

the column rank of A. 

We note that the above proof is valid only over the real and complex 
fields although the result is true for arbitrary fields as was seen in 
Chapter 4, The interested reader can look up r for example, 5. Lang, 
linear Algebra [Addision-Wesley), to see how the general case can be 
handled by similar methods, where (iv) of Definition 5.2 has been 
replaced by anothei condition (non-degeneracy of inner products) 
which allows the above to be applied to V^(K) for arbitrary K 


146 


CHAPTER 6 


Diagonalization of Matrices and 
Linear Transformations 


6.1 Introduction 

Let .1, b E M n l A"), then in Definition 4.5 of Chapter TV we have defined 
similarity of matrices by saying that B is similar to A (written A B[ 
if there exists an invertible matrix^'EM^A") such that 

b = f x ap 

The following lemma is easily proved. 

LEMMA 6 A Similarity of matrices is an equivalence relation cm 

PROOF ^ is reflexive since A = I" 1 A i for all A E M n (IT), ™ is 
symmetric since if A B (here exists an invertible matrix FE M„{K) 
such that B = F~ l AP from which it follows that A = (F -1 )" 1 BP" 1 and 
ft ^ A Finally. - is transitive since if A ^ B and 5 ~ C there exist 
invertible matrices P t Q £ M n {K } such, that B = P~'AP and C’ = Q 1 HQ 
and hence c= Q^F'APQ = [I*Qr l AiPQ), where PQ is an invertible . 
matrix in Af n (A r 'L 

This means that M n (K) is partitioned into equivalence classes under 
this equivalence relation, We have the problem of determining 
representatives of these equivalence classes which are in as “simple 1 ' it 
form as possible. This wUl be one of the main goals of ibis chapter, 

This, problem may also be formulated in terms of linear transformations, 
Lei V be a finite dimensional A'-space with ( V -K) - n and J'E y\ I 7 )- 
In Chapter IV, we saw that the mairices of T relative to different 
Abases for V are similar to each other, Tims,, the above problem is 
equivalent to that of determining a A-basis for V such that the matrix 
of r relative to that AT-basis is as "simple” as possible. To this end, we 
define in the next section the eigenvalues and eigenvectors of a matrix 
(or of a linear transformation). 
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This may be further illustrated by considering an example. A linear 
transformation T On K 5 (R) is defined by 

Te, = 2t L ~e 2 

J>i - 3e, - 2ej 

where ■! 1 1 . e a } is the standard basis. Given an arbitrary point 

(M)e FjCRXiheii 

FfX, A? — 2Xc t — Xe 3 4 3j^ei — 2^.e 3 
= (2X 4- 3p, - X - 2jU) 

Now let e[ = ^ ~e lt e 3t then fej, ej) is also a K-basts for 

fi(R) and 

Fe, - 3(T’-e!} — 7e 2 = fifli — Je 3 — 3ei + 2e s = 3«j - e a = e 

Ffij = r«j — Fcj = — e a —3 ej + 2e a — — c 5 + e 2 = — cj 

and r(X,jtr} = (X, — where now (A*^) are the co-ordinates relative 
to the R’basts 'Ifij.ej). Thus tbeeitect of the lirit*:ir transformation T 
t'ti an arbitrary point (or vector) is tar clearer In terms of die second 
ft-basisj.e. we have reflection in the first axis e' 3 as shown in the 
Fig. 1 . i.e. to find the image of rhe point F we draw a line through/ 1 
parallel to e 3n the image of P will be at a point P r so that PX = XP\ 
where X h (he point where this line cuts the e[-axk. 



Figure t 
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6 ,2 Eigenvalues and Eigenvectors 

DEFINITION 6.2 (1) If A £M n (Kl then art element \ € K is called 

an eigenvalue of A if there exists a nonzero X t Y n (A") such that 
AX = XX (X is a column vector), The vector X is called an eigenvector 
corresponding to the eigenvalue X. (2) If V is an n-dimenstoml fC-spaee 
and TG £'( V) then an element l€. K is called an eigenvalue ofT , if 
there exists a non-zero vSV such that Tv = Xu, vis called an eigenvector 
corresponding to the eigenvalue X. 


The connection between (1) and (2) is brought out by the following 

EM »the matrix of T relative to a /f-basts [v . v n ) and 

X is an eigenvalue of T and v is an eigenvector corresponding to X and 


ti L 

v = £ fi t ; put Jf = . then AX 


of A, Furthermore, if ■&' ™ t p Ii ■ 
(TT,. = PAP \ where P - (p u ) and v ; » 


\X, that is, X is an eigenvalue 


} is another AT-bans for V, then 


J t>/(/ = J* - • 


(see p.98) and hence 


(PAP~')tPX) = UPX) 

Le. X is also an eigenvalue of PAP 1 with corresponding eigenvector PX 
(which is non-uero since P is invertible). Thus, we could have defined 
the eigenvalues of a linear Trans formation to be the eigenvalue of the 
matrix of T relative to any Ml for V. In the sequel, we concentrate 
on matrices but will state and prove some of the results in terms of 
linear transformations. 

If X e K is an eigenvalue of 4 G M n (/Q then from Definition 6.2 
there exists a non-zero column vector X such that 


(A — XI) Jf - 0 

By Corollary 3 to Theorem 2J such an X exists if and only if 

det(v4-M)~Q. 

Thus we have proved 

THEOREM 6,3 X e K is an eigenvalue of A if and only if 
det(A-\T)=Q. 

If A e M n (JO. then del^ - x 1) is a polynomial of degree n in X. 
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DE FIXATION 6.4 \ - del {A — xf } is called ihe characteristic 

polynomial of ihe matrix A. 


Thus, Theorem 6.3 may alternatively he stated as 

THEOREM 6 j' Xe* is mi eigenvalue of A if and only if it is a root 
of the characteristic polynomial of A. 

This gives us a practical method for computing the eigenvalues of A, 
is & polynomial of degree n in x: by the so-called fundamental 
theorem of algebra, every polynomial of degree n over the complex 
field factorises completely into n linear factors over C, 

Le,if SC^ IjcJ — <“1)"CJf" + ,.. + «*), 

wltere ji, ct 2 < ■ ■ ■. ^ £ C, (hen 

X A (*) = {-!)"(*- Xt){x - XJ . (x - x„) 

where X )t , Xj,., . r j\ n 6C. Thus over the complex field, an n x n matrix 
has at most n eigenvalues (and has at least one eigenvalue f It is also 
dear that the existence of eigenvalues depends on the field over which 
we are working, 

EXAMPLES 

*•«*-(.? o) 


—X 

X A ix) = 


] 


* a + 3 


which is irreducible over R l i e. does not factorise in R), hut it factorises 
over C to give 

X A (x) = fx + i)(x - 1 ) 

Hence A lias no eigenvalues in R hul has the eigenvalues i and “i in C. 

2 - UA m C-t i) ,hen 


\2—x 1 


1 ] 

= 

= d -X ) 


1 -1 -x 


-1 -X 


Thus A has one eigenvalue A = S in R (and also in Cl. 

Once the eigenvalues have been determined, the corresponding 
eigenvectors are easily calculated, i.e. if A = (q^j and X is an eigenvalue 
of/I and X = (x lt v*, . . , t iJ is the corresponding eigenvector, then 
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from Definition 6.2 X is a non-triviaI solution of the system of linear 
equations 

(fc tl -X)x, + nu*i + .,, .+«!*** = 0 

f-oij-j — X)Xj + ,. . + — fi , 

a„ k x 3 + u, fJ x 2 + * ♦, + fow, - X)Jf H = o 

A non-trivia) solution certainly exists since det {A - M > “ 0- We shj]l 
see later (Theorem 6.9), iha( the number of linearly independent non¬ 
trivial solutions is no higher than the multiplicity of x —X, in 

Itt the above two examples, if A = ^ corresponding to the 

eigenvalue t, we must solve 

-ixi +x a = 0 

-Xi- lx, = 0 t 

Since reduction of the matrix of coefficients gives 

G-IH'li) 

then all solutions are of the form a {1 ,i), a ^ C and thus t . ) is an 
eigenvector corresponding to ihe eigenvalue ?v = L that is 

U -I) C)-C) 

Similarly, Jf X - -i then 



and ^ ^ is an eigenvector corresponding to the eigenvalue X - h 

In ihe second example, when A - ^ q) (hen % A 1X) = (X — l > 

and 

u :) 0 -o 

and there is only one linearly independent eigenvector corresponding 
io X = 1. 

EXAMPLE As a further example we have 
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/3 2 4 ' 

4-202 

\4 2 3j 

then (he characteristic polynomial ^ u) is given by 



3 - x 2 4 


—I —x 2 

4 


2 -x 2 

4 2 3-jt 


0 -.v 

1 +x 2 

2 

3 — x 


- fl +*) 


-1 2 
0 -x 
I 2 
- -(* + I iHjt-S) 


4 

2 

3~x 


= {x + l) 


2 

7 A 


The eigenvalues over R are 1 and 8, 

Corresponding to the eigenvalue \ - —I, we have the system of linear 
equations 

4 x, + 2 x* + 4 *J = 0 i 
2*i + .tj -4*2*, - 0 

4xj ±2x 2 f 4.Tj = 0 
which clearly reduce to the one equation. 

2x^x 1 + 2x, = 0 
he, x 3 = — 2 xi — 2 xj 

and (1, —2.01 and iO. —2.11 are two linearly independent solutions, 
Thus, corresponding to the eigenvalue A = -1, there are two linearly 
Independent eigenvectors. 

M 2 

If A = S, then ( 2 -fl 
\ 4 2 

eigenvector corresponding to (he eigenvalue > = S. 

In order that the above ideas may he extended to cover lineai 
I ransformalions T, we prove the following lemma, 

|_E MM A 6.5 Similar m$ trices hav e the name characteristic polynomial 

md hence the same eigenvalues. 


i) (!)*(S)- , (!)“ 
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PROOF If A and B £ M n (K) are similar matrices, there exists an 
invertible matrix Psueh that i? = PAP' 1 . Now the characteristic 
polynomial of B is 

= dftt {B - xlj = det (Rif 1 — xi n ) 

= tfct( PiA-ZlJF- 1 ) 

— (det P) det M — xl n \ de l (P ~ L ) 

= det {A -xl„) 

= x 4 W 

where we have used the fact that the determinant function is 
multiplicative (Corollary 2 to Theorem 2.7) and that - 

dei(/ >-t ) -(det FT 1 , • 

Thus, if TG d/ \ n, since die matrices of T relative to distinct 
K -bases for Fare similar to each other, (see Theorem 4.61 the following 
definition of the characteristic polynomial of T is unambiguous. 

DEFINITION 6.6 // T e Sf{V) t the cfmratterisiic polynomial of Tis 

the characteristic polynomial of the matrix of Trelative to any K-basis 

for K 

We can now prove 

LEMMA 6,7 Let \ be an eigen value of A G M n IK H 7 £ F)) and 

let F(X) denote the set of eigenvectors corresponding to X together 
with the zero vector. Tnen FfX) is a sub space of V n (K ) ( F), 

PROOF It is clear that F(X) is the solution space of the system of 
linear equations represented by 

(-4 - U n )X = 0 

and by §3,3. Example 4. it is a subspace of V n {K). . 

f Similarly Ff A) = ker[T — Alp) which by Lemma 4,7 is a iubspace of F), I 

DEFINITION 6.8 F(X} hr called the eigenspaee corresponding to the 

eigenvalue A, 

The next theorem gives an upper limit on the dimension of F(A), 
that is, on the number of linearly independent eigenvectors corresponding 
to the eigenvalue A. 

TH EOREM 6.9 If A is an eigenvalue of A e M n (K } {T £ Sf ( V )), then 
( VO, }. K) < multiplicity of lx — A) as a factor in the characteristic 
polynomial x A {x) (x T fa ?))■ 
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PROOF Wc shall ve ihe proof in terms of linear transformations, 

Suppose that t,P(X): K) = t Jet fx> t ,- v r } be a K- basis for V (A), 

which is extended to give a A-basis JB — {i? 5l .., * v /+ ...., n M ) for V. 
Then we have Tv, - \v f (/ = fj and 



X ... 0 

\ 


* . , 

a 

{T}# = 

. . . 


l 

0 ... X 


\ 0 

At 


where we are not interested in the explicit values in the pari indicated * 
and A is an (ft — r) x (n — r) matrix. Thus 


X T (X) = 



|X — j“ ■ -o 

. \ 

det 

6- - -x^x 


° 

A X'lfl -.f j 


= (X — jr) r dz\{A — jt 1^ 


Hence (X — jr) r is a factor of the characteristic polynomial of T and 
thus r < multiplicity of (x — X) as a factor in the charade fistic 
polynomial x r <*) of T. 


Exercises 6.2 

I. Find the eigenvalues of the following matrices over (a) the rational 
field Q, (b) the real field R, ft) the complex Held C, 

0) / t Vl\ (ii)/l -i -IV 

'-V? i ) f 1 -i o 1 

\1 0 -1/ 

(iii) / 1 0 0 0 0\ 

0 1 I 0 0 1 

01-100 
0 O O 1 2 

\o 0 O -] -1 / 
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2= Find the characteristic polynomial, eigenvalues and eigenvectors of 
the following matrices Over the Complex field 


(0 

j ! 0 


(ii) 


I 0 1 -. 


1 2 

1 


0 

0 1 


\2 2 

3/ 


\l 

-3 ll 


(iii)/ 2 i 1+2U 
-i 0 -1 

\L-2i i 0 f 



1 1 
1 0 
0 1 
1 1 


°\ 


(v)/3 2 2 -4\ 

2 2 2-1 

1 1 2 “I 

V 1 2 -'/ 



“I I 1 

0 2 2 

! 0 -1 

0 -2 -3 

0 2 4 


0 

5 

-1 

-2 

3 


\ 

/ 


3. (A), prove that AB and BA have the same eigenvalues, 

4. If X|.,,., X„ are the eigenvalues of .4 EM n (K), prove that 

fi) if A is invertible, 1/X h . ,. , 1 fk n -ire the eigenvalues of A~\ 

(ii) X*,... t X* are the eigenvalues of A k (k = 1,2,,. ,)► 

What aie the corresponding eigenvectors'] 


5, Find the eigenvalues and eigenvector of the differentiation 
transformation D orl P n (R), 


6. II A £ M n \K i„ prove that A and A J have the same eigenvalues, 

7, Find the eigenvalues and eigenvector* of reflections and rotations 
in FitR} over the real field. 


S, Find the characteristic polynomial of the following rr / f] matrices 


(i) j o 0 ... 0 ttA 

1 0 ... 0 A; 

0 I , , , 0 ftj 


,0 0 . . . 1 


(ii) j\+h n 

1 it + b 


4= . ..tf"" 1 

4 3 ... 4 n ~ l 

J + b . *. a” " 1 


I'-'+b 
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6.3 Diagonal Nation of Matrices 

DEFINITION 6.10 (i) A matrix A E M n (K) is diagonalizehie if there 

exists an invertible matrix P such that P~ } AF is a diagonal matrix. 

(ii) A linear tramformatUm T E ( V) is (Iwgtmalisable if there 

exists a K-bus is for V such that the matrix of T relative to this K-basis 
is a diagonal matrix. 

It is dear from what has been said earlier that these two definitions 
are equivalent. 

We now prove a necessary and sufficient condition for a matrix to 
he diagonalizable. 

THEQR EM6.lt A matrix A G M n ( K ) y T £ Sf i V\) is diagonaiizabk 
if and only if a set of eigenvectors of A{T\ form a K-basis for ( V). 

PROOF If .4 is dlagonalizuble. then by Definition 6,! 0 there exists 
an invertible matrix P such that P~ i AP — D = diag( A^ A^,, „ - , X^Jl 
S ince similar matrices have the same eigenvalues, the eigenvalues of 4 
are X, p ..,, Ji fl . Let P = (Cj, C 7 , ...,g, where C ( (i- 1,,.,„ n) 
indicate the columns of P. Since/ 3 is invertible, {£-1, ., r , C rt }is linearly 
independent over A' and thus forms a A.'-basis for V n (K). Now 

AP = PD 

oiA(C r , C a . CJ - (C lr C 3 - CJ tlixgfru .AJ 

implies that 

AC t = A^C f (i = 1,. T T ,ri) 

that is Cj is an eigenvector corresponding to the eigenvalue A, of 4, 

Let {Xi, Xj .JfJ be a, linearly in dependent set of eigenvectors 

of A. Suppose that Lhese eigenvectors correspond to the cigenv allies 

A,. A Jf ,.,, X n (not necessarily distinct). If \X U JFi.is linearly 

independent over K then sf/ , = (JK]i A^, ,. ., X n ) is the UX *1 matrix 
formed with X t (/ = l T .,. a rt) as its columns then by the Corollary to 
Theorem 4,18. P is invertible and by inverting the above argument we 
have that 

- A ( X ( (i = 1,. .. , n) 
implies that 

P l AP = diag{A lt A lt ..,,Aj I 

The above theorem implies that if A is diagonal](table then y ( (jc) 
factors completely into Linear factors. 
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We can now prove that 

THEOREM 6.1 2 If A E MJK){T E ¥{V)) has n distinct eigenvalue 
then A{T) is diagomliiable. 

PROOF Let >, Ll X 3 . \ n be the n distinct eigenvalues of A arid 

Jfi, X 7 ,,.,, X n be the corresponding eigenvectors, thus 
AX) - A ( - X t O' = 1,..,, n) r We need only prove that {X lt X 2 ,. . yX n ) 
is linearly independent ovet A then the proof will be compiele by 
Theorem 6.1 T The proof of this is by induction on n. This is dearly 
true when n = J. We shall assume that X 2i ,.., is linearly 
Independent over K, where 1 < r — 1 Oj, Consider 

CL X Xi + Ct 1 X 1 V .. . = 0 

where a. E. K (i = \, + + . . r). 

Premultiplying by A gives 

0! X|Ah + a? AjJfj + . .. + a r A F X t = 0 

and subtracting this from \ f times the previous equation gives 

But {X \,,, . , is linearly independent over K and so 

ft,{X r -A ( ) * 0 (i = lr,.. ,r— 1> 

Furthermore (A f — Ari (/ = t t . . . 6 r — 1) since the eigenvalues are 
distinct and so a 9 = o^ = , „ . = a r _ I = 0 and a r X r = 0. and since 
Xf. 0, q^. = 0, i.e. ■( Jf,. . ,., Xj) is linearly independent over K . 
{l n} ( 

From the proof of Theorems 0.9 and 6.11 we have the following 

CO ROLLA RY If A € M n (K) is dingo nalizabie then 

(Vi A ): AY = multiplicity of (x — A) as a factor in x A (x) for each 

eigenvalue A of A. 

We note that the converse ts also true when the characteristic 
polynomial factors completely into linear factors, e.g, when K - C. 
w« refer back to the earlier examples (pp. 151 1521. 

EXAMPLES 

1. tfA = (_J ’),p U t/>=(! J), then 

p-'AP = dia&(i, —f) 
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2. If A = ^ ^ Jb then since (1. — I} is the only linearly independent 

eigenvector corresponding !■.' the only eigenvalue I . ([ J (l i : R) = 1 and by 
Theorem 6,1 1.,4 is not diigonalizable. 


(9 2 4 \ 

3, \(A = 2 0 2 , the eigenvalues arc —1. 8. 

\A 2 31 

We have shown Lhat {(J, —2, OK (0, —2, 1)} is a R-basis Cot I 'f l) and 
{(2„ E, 2)} is a R'basis. for TiSi. If we pul 


P = 


/ i 
“2 
l 0 


0 

“2 

I 


then 


P~\AP = diag{—1, — L 8} 


We now assess the progress which has beer made an the problem 
which was the main motivation fot the work in this chapter namely 
that of finding matrices of a “simple 11 form to be representatives of the 
equivalence classes under the equivalence relation of similarity. We have 
seen that in certain circumstances the “simple" form chosen is a 
diagonal matrix, but unfortunately, as we have seen in Example 2 above 
this simple form cannot always be chosen to be a diagonal matrix. We 
now state the solution in the general case without proof, the proof 
being beyond the scope of this book. 

We assume that K = C the complex field, 

Lei .4 € A/ n (A'} have charac lens tic polynomial 


X4O) = (-D" U - - *>)"■ . *,)"» 

where Xj. Xj, . , . „ Xj are the j distinct eigenvalues uL A and 
i?i 4- rt 2 + ... 4- n s = n 

Lei 


J(Kr) 



l 0 
\ I 

0 '' . 




£M r (K\ 
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If row m i |, wi. *, , , .w„ arc positive integers such that 

m n >m /2 > ... ^ m ia and 


lei 




= 


0 J(\j, m^j) 

\ 0 


then the matnx A is similar to the matrix 



M«i) 

0 


J = 


0 

Am) 




i'or some choice of (1 — l r ,.«, s j = l t l t .,.. Jjj satisfying the 
above condition. Such a J is called the Jordan Canonical Form of A, 

It will be noted (haT J has the eigenvalues of .4 as diagonal dements 
and a distribution of zeros and ones on (he superdtagonal and zeros 
elsewhere in the matrix. 

This is best illustrated by an example, ilt the ease rr = 3, every 3x3 
matrix A with complex dements will be similar to one of the following 

/X 1 

0 X 
\0 0 

X 0 
0 X 
0 0 

Exercises 6.3 

1. When possible, find an invertible matrix P such that P AP is a 
diagonal matrix If A is 
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0) (i -1 -l\ 

I -I 0 

\ I 0 -1 / 


(H) /l 0 

l;: 




\ o 


-ft -12\ 
4 4 

0 1/ 


(iv) 



0 i \ 

I + i 0 

0 2 — 1 / 


Cv) /-l -1 -6 3\ 

j 1 ”2-3 0 | 

U 1 0 . 

\-1 -J “5 3/ 


(Vi) / 3 

- 1 

—2 

n 

(vii) 

I 1 

1 

1 


3 

-I 

“2 

1 


0 

1 

l 

> 

3 

-1 

-1 

2 



0 

—! 

- 

\i 

0 

0 

1 / 


\o 

0 

0 



2, Find the eigenvalues and eigenvectors of each of the following 
matrices 



over Q l Show that ,4 is similar to a diagonal matrix and explain why B 
is not. Find an invertible matrix Fsuch that P~ l AP ts a diagonal matrix. 


3. Determine the eigenvalues of the matrix 
/1 a a 2 0\ 

I it 0 

A = 

L 0 a a 2 

\ 0 1 a a 1 ! 


Find an invertible matrix P such that P V AP es a diagonal matrix. 


1 

4. If ,4- 0 2 

\G 0 


I and/* is an invertible matrix, by considering 

3/ 


{P~ v APf or otherwise, find 4 F| . where n is a positive integer. 
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5 r Find an invertible matrix P t such thatF s 4jP is a diagonal matrix ii 


4 


/— I 4 -2) 
1 -I 1 
V 3 —6 4/ 


Hence, find a matrix Xi^ ±4 ) satisfying X 2 - A. 


6.4 The Minim um Polynomial of a Matrix and the Cayley-Hamilton 
Theorem 

Throughout this section we assume that K ts the complex field. 

In §3.4. we saw that {M n (K) \K)= ft 2 Titus, if 4 E M^K). the set 
{|, 4,4 3 . ■ , A* *} Is Lirtcii rl y d e pend m t ove t A r . i.e. there exist 
a n , a .. a , E K. not all zero, such that 

tt 

I + Qt4 4-.,. + 4" — 0 

I f we put 

/(.Jr) = 0t o + eti X + ... + a rr ti n 

then 

f{A) = 0 

If now m is j positive integer such that {l T .4 t A 2 , . . . , A m 1 1 is linearly 

independent over A" and {1,4. A 2 , .4' M } is linearly dependent 

over K r then there exist fS 0 , |G| t , .,, E A.’ with =£ 0 such that 

tf o l+0 t 4 4-„..+(J m 4' H = 0 

or 

To l + 7 , A+ A"" 1 + A m = 0 

where y t = & { IB m ( 1 = 0, l. m- 1), Hence, there exists 8 tnonic 

polynomial f(x) of degree m s; u 2 such that f{A ) = 0. We can now give 
the following definition: 

DEFINITION 6.13 A minimum polynomial of u matrix A E M n (A.) 
is the monic polynomial m (x) offcast degree sm'h that m (4 ) = 0. 

The above argument shows that such a polynomial exists and is of 
degree at most rr. Our aim will be to obtain further restrictions on the 
degree and form of minimum polynomial which wil] prove useful in its 
evaluation. 
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The minimum polynomial of a linear transformation TG Jt^(F) can 
be defined in a similar way by using preciseLy the same arguments in 
the vector space &*{V) a 

We now prove a series of useful lemmas concerning the minimum 
polynomial 

LKMM A 6,14 The minimum polynomial of A G MJK) is unique. 

PROOF Let (x) and m\x) be minimum polynomials of the 
matrix A They arc dearly of the same degree, Lei/(jt) = m(;0 —flifa), 
then f(x) is of lower degree than and .7i r (je)i (since both are monk) 
and f(A ) = m (A ) — m'{A ) = 0, which leads to a momc polynomial of 
lower degree than m(jr) satisfying the requirements for a minimum 
polynomial and which contradicts the definition of fft(x). Thus _ 
m(x) - m'(x) - 0, orm(jc) - m'fjr). 

LE M M A 6,15 The minimum polynomial m{x) of A £ K) divides 
every polynomial fix) such that f(A) = 0. 

PROOF By the division algorithm for polynomials, there exist 
polynomials<?(x)*r(x) such that 

fix > = $(*)iHfr) + i-(jr) 

where r(Jf) - 0 or the degree r< degree m(x)h Now 
r(A) = f(A) — q(A)m(A > = 0 

which means that if degree r{x } > 1, we have a polynomial of lower 
degree than m(x) satisfying the requirements for a minimum polynomial-. 
Thus r(x) = 0 and m(Jc) divides f(xf 

LEMMA 6.16 Similar matrices have the same minimum polynomial. 

PROOF If A>B £Af pr (A') are similar„ then there exists an invertible 

matrix P such that 

P~'AP = B 

It is easily shown by induction that for k > l 
P~ l A k P - B k 

and if/fctf) = a 0 4- * 1 ^: + , .. + x m then 
RB) = + + 

= c^r'P + a, F l AP + .,. + <x m P i A m P 

- r'f{A)p 
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Thus if/(/4) = 0 then f{B) =■ 0 and conversely. | 

The result now follows from Lemma 6.15, ® 

We now prove an important theorem which gives further restrictions 
on the degree uf the minunum polynomial, indeed that the degree of 

THEOREM 6d 7 (Cayky-Ihm^ion Theorem) If x A U0 (hr 
characteristic polynomial of A, then {A ) - 0 or alternatively, 
‘'every matrix satisfies its characteristic polynomial". 

PROOF If A £ M n {K)i let the chaiactertstic polynamial olA be 

x A (?) = (“0* l* fl + *"~ l + ■ ■ ■ + O 

By §2,4 t we have 

{A — Jl)adj(.4 — jell = i> 1 —jcf[ . I - - i 

Now, by considering the form of adiM vl), we have 

adj {A —jeJ> - where p^fje) are polynomials of degree ai most 

n - 1 in x, Thus adj [A - Jtl) may be expressed in the form 

adj (A -x\) = if 0 + B t x + ... + B„ *"‘ l 

where Bo.Bi, ♦. * T B n _ l GM 7} (K) r By comparing the coefficients of 
powers uf x in 

(A + ,+ = (-!>"(*" + a, Jr"' 1 

we obtain 

AB 0 - 

-B a + AB } = C-l) fl 3 rt ^,I 


“Vi - MV I 

Premultiplying these equations by l . A . A n respectively and adding 

gives 

0 - {-!)"(■.+ 11 ,.^ + ...+A*) = x a [A) I 

Tile above results lead immediately to the following useful 


CO RG LLAR Y 77ie minimum polynomial of a matrix divides its 
char act eristic polynomial. 
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PROOF This foflawi from the above theorem and Lemma 6.IS. i 
EXAMPLES 

1. If A = drag (1,0, — L}, then the characteristic polynomial of A is 

\(X — I)(X + I), By calculating^ 1 = diagl 1.0, E1 and A i= diag(l, Q,—1) 
it is clear that no linear relation of lower degree than ,4 3 — A = 0 is true. 
Thus the minimum polynomial and charactcrastic polynomial coincide in 
this case. 

/0 0 I\ 

2, If A — 0 0 OLthen the characteristic poly normal of A isx 3 

\o 0 Of 

and since A* = 0. A ^ 0, the minimum polynomial is .r J . Thus, the 
characteristic polynomial and minimum polynomial need not be the 
same in general. 

T H EO R.F M 6,18 772? distinct linear factors of the mmimum 

polynomial coincide with those of the characteristic polynomial. 

PROOF Let the characteristic polynomial of A be 

%a (*> = c-i > n <* - ^ 

where X,j t Xj.. T T , are the distinct eigenvalues of A, Then by the 
corollary to Theorem 6.17, 

m(x) - (x - \|) s ’ (* - hf* ... (x - \ k f* 

where 0 < < m t (i = 1,. >,, £)♦ We must show that £ . > 0 for all 

i = l p 

Suppose that for some I 0. then m(Xy) #0. But. if 

X is ail eigenvalue of A , then there exists a non-zero X £ V n {JQ t 
such that 

AX = XX 

and by induction 

A k X - \ k X 

for k = 1,,., and furthermore 
m(A)X = m(X)X 

Thus, if m(X)^= 0 for some eigenvalue X this, would mean that 
m(4) ^0 which would contradict the definition of the minimum 
polynomial. Hence, no such eigenvalue X f can extst and £, > 0 for all m 
>=1. k. 
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COROLLARY If a matrix A E M n {K) has n distinct eigenvalues, then 
its minimum and characteristic polynomials coincide 

We can now stale an important enteriun for a matrix to he 
diagonalizabie in terms ofits minimum polynomial. A proof is not 
indu de d. 


THEOREM 6.19 A matrix A £ Af n (JQ with k distinct eigenvalues 

\i. \ k is dwgowliiable if and only if its minimum polynomial is 

(x - X,J ., , (x - \ k h 

EXAMPLE 


1. Efvl = 


A l 0 O 1 ' 

0 10 0 

0 7 ^ I then Its characi eristic polynomial is clearly 

i .0 0 0 2. 1 


(x — l) 2 (x ~ 2) 1 . By Theorem 6. IS, the minimum polynomial of A 
must be one of (if (jr — l) {x — 2); (ii) (x — 1 } a [x — 2) 

W {* - D(* - 2)’; W C* - 3 >’<* - 1? 

The minimum polynomial is now determined by systematically 
eliminating these possibilities. 


{A ~ i)(A - 21) 



I 0 

0 0 
0 1 
0 0 



I 

-I 

0 

0 


0 0 
0 0 
0 0 
0 0 


(A-TftA-21) 



-1 0 o\ 

0 0 0 \ 

# 0 

0 0 0 j 

0 0 0 / 


1 

0 

0 

0 


0 

0 

I 

0 



0 

0 

0 


0 

0 

0 

0 


\ 

'J 


Titus the minimum polynomial is {x — 1 ) 3 (x — 2) and the matrix A is 
not dUgbnallzable. 


165 














2, It A = 


2 4\ 

Q 2 !. then the characteristic polynomial ts 
2 3t 


—(x +■ 1 ) J {jf — 8), We see that 


\A + [\(A - 81) 


/ 4 

2 

\ 4 


2 

1 

2 


4\ 

2 

4/ 


/-5 2 4V 

2 ^8 2 1=0 

V 4 2 -5/ 


and thus the minimum polynomial of A is (jr + 1 )(x 8) and so the 

matrix A is diagonaiizabie as we have seen in the example on page 155, 


Exercises 6,4 

J. Find the minimum polynomial of the following matrices 


0) 


f I -L 

H 1 


(ii) /I 1 Oi 
1 0 



(iiij /I 0 O' 
(OI 1 


\0 


0 2.1 


2, Find The minimum polynomial find ehaiacIciisEic polynomial of the 
mairix 

, ; G 1 0 * . . 0 \ 

0 0 i . . . 0 1 

0 0 0 1 

\ 

ff l a 2 ■ - - 

Given a polynomial/( je) of degree n t Find EtiRKn matrix with/(s) as 
its mmimum polynomial. 

3. If a matrix <4 has characteristic polynomial {x l) 3 (x + 2) a (*-—3)< 
find all the possible minimum polynomial! of A. Find matrices A which 
have these polynomials js their minimum polynomials. 
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4. Give a direct proof of the Caytey-Hamilton Theorem for 
(i.) diagonalkable matrices^ (ii) triangular matrices, 

5. By calculating the minimum polynomials determine which of the 
following matrices are diagonalizable: 





4 

1 

4 

0 



(iv) /3 -4 Q 

1 -I 0 

2 -3 1 

0 0 0 



6 r 5 The Diagonals a l ion of Symmetric Matrices 

Let Af^(R) denote the set of all real symmetric n ■ a matrices. We 
shall show that in this case* the problem considered in Section 6.3 
can be solved completely, 

DEFINITION o.20 A , B E M^\R t we said to be orthogonally 
simitar if there, exists an orthogonal matrix P+E \f n {H I such that 

B = P'AP 

(note that if P is orthogonal P'P ~ FF l — and soP -3 — f c ), 

We first prove two lemmas, 

LLjM M A 0 21 The eigenvalu a of a real symmetric matrix are all real, 

PROOF Let A £Af^(R) and h be an eigenvalue of A with 
corresponding eigenvector X e ^ n (R)i then 

AX = \X 

Taking complex conjugates and then transposes we obtain 
AX = \X 
and 

X l A l = lx 1 
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Thus, we have 

= XX l X = 3UT*Jlf 
from which it fallows that 
(X—X)(X l -Y) = 0 
Now. if X = (Jtj, x ly .. ., x n ), then 

hY'X = x s X| + . .. + x n x n — |jf J 2 +- „ , + + I-tJ 2 t^O and thus \ = X _ 
and X is real, 

L EM MA 6.22 If the eigenvalu ns of a real symmetric matrix A an ail 
distinct then the corresponding eigenvectors are orthogonal so each 
Other, 

PROOF Let X f . X 3 .X n be the distinct eigenvalues of A with 

corresponding eigenvectors X lt X 2 ,.... X n > i.e, 

J,e. AXf — \ l X i (i = ] r 2„ ..., a). We wish to show that if i * /, 

(X,, ,v r )=.v; *,=o. 

We have that 

x\a = \ { x; 

and 

X}AX f = \ t X}X f = \ f X}Xj 

or 

<>, -x,tx;x ( = o 

from which It follows that X/X ( - = 0 since A, — X, ^ G. 

From these two results ft now follows that 

THEOREM 6.23 If .4 is a real symmetric matrix with distinct 
eigenvalues then A is orthogonally similar to a diagonal matrix, 

PROOF Let Xi., Xj,..., X n be the eigenvalues of A and X s ,X il ., , ,T fl 

the corresponding eigenvectors. Let Yj — .¥j (r -1.2,,, . rr) md 

I A| | 

put P = (T Xl Y t , ,,., Yj r then P is an orthogonal matrix, since by 

Lemma 6,22 above (Y fr Y f ) - 0 (i^f) and ( Vf, Ty) = l{i,f b= 1 „ 2,_ t tt). 

Furthermore, T iF Y t . .,,, Y n are also eigenvectors corresponding to the 
eigenvalues X,. X 2 ,., , , X r| and by Theorem 6.11 

F'AP = r',U> = diag(X„ \) 
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In the next theorem, we see that this result is even true when the 
eigenvalues are not distinct. 


THEOREM 6,24 Let A he a red symmetric n x n matrix. Then, 
there exists tf*i orthogonal matrix P such that P ! AP — ding (X^ X %, ..,, . X„ j 
where Xj, Xi,... , X n are the eigenvalues of A (possibly repeated). 


PROOF The proof is by induction on n. 

If n = I, the theorem is trivially Irue. 

if n > 1, we assume that every {n 1) x {n — 1) real symmetric matrix 
is. orthogonally similar to i diagonal matrix. 

Let X be a eigenvalue of A and X the corresponding eigenvector, 
i 

thus A X = XX. Put ,Y] — — X, then by the Gram-Schmidi 


orthogonalizauun procedure [see Theorem 5.6) an orthonormaj fubtsis 
Xi ,... »2f n ) for t^(R) may be constructed. 

Put U — (A'i, X 2 ,. . , . ,Y n ), then U is an orthogonal nun matrix and 


U*AU =' 


UXoXd 

’ \ 

HX 7i X t ) 



B 

MX^Xi) 

/ 



where B is an (ij ~ l) x (n — 1) matrix. SrncE A is a symmetric matrix 
and 


(ifUoy = u lA u 

then U\4Uis a symmetric matrix and B is also , : i symmetric mauix and 



Now. by the induction assumption, there exists an (n — 3 \ ■ fn — U 
orthogonal matrix V such that 
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V l BV * diag(X ap ,,., \) 

where Xj,.., , X rt arc eigenvalues of B, and hence also eigenvalues, of A. 

Let 


■ ■ (s-K) 


r - 

then is an n * n orthogonal matrix and 
V' l U'AUV* = V** 


(H> 




* Jtag(X. X 2) , \J 

and UV'is an orthogonal matrix, which completes the proof. 
EXAMPLES 


, then the characteristic polynomial 


10 -x -14 “10 

X A {x}= -14 ?-* -4 

“10 —4 19 -x 

which on evaluation gjves 

= (x- 1B)(*-27 )(je+9) 
and the eigenvalues are X = IS, 27 and —9. 


-s 

—14 

-10\ 

-14 

—n 


-10 

'"4 

1/ 

r 19 

-14 

-10 1 

-14 

16 

—4 

-10 

-4 

2B i 


if X = -9, then -14 


/—17 -14 -10 

and if X = 27, then | -14 -20 -4 

1-10 -4 S 
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If we now Lei P— 4 



2 

1 


1 jthenPis an orthogonal matrix and 

2 / 


P l AP = 1^1(18,-9,27) 


2. JMH-1 


U& = 


-1 

7 

2 

7 — x 

-1 

-2 


2 then the characteristic polynomial of 4 ts 
10 / 


-I “2 
7-x 2 

2 10-x 


(x-fitftac-Kt}; 


the eigenvalues of .4 are A = 6 and A = 12. When A - 12. then 



and when A - 6, then 


I 1 -1 

-A 

(i 0\ 

-I 1 

2 

1 ‘ 2 

\—2 1 

41 

\0 -]/ 


The two vectors (1. 1,0) and (0, 2, — 11 are not orthogonal to each 
other < blit by applying the Gram-Schmidt orthogonallzatiun procedure 
we obtain 


J-j - ( 1 . K 0 ) 

y t = (0,2,“1) “(1,1.0) - t-M.-D 

Then (L, 1.0) and 11, - 1,1.) are orthogonal vectors which are 
eigenvectors corresponding to the eigenvalue X = 6. Now, by 
normalizing each vector and putting 
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Izl A. 

I >/6 

1 1 

V6 y/2 

0 



i 


h 


we have that F'AP - diag( 12.fi, 6), 


S& 

A 

0 


VT\ 

-V? 

V?/ 


Exercises 6,5 

L Find an orthogonal matrix U such that U r AU ts a diagonal matrix 


for the following matrices,^ 


(i) / 1 

0 

-4 

(ii) 

( n 

| “ 

5 

4 


0 

1-4 

4 

3/ 


6 

M / lb 

-1 

-1 

IS 

-A 

"4 



\~4 

“4 

3, 




0 6 \ (iiij I 7 -I -2 

5 6 -I 7 2 

6 -2/ \—2 2 10 


ft.tj Quadratic Forms 

Throughout this section we assume that V is a finite dimensional 
R-space, 

DEFINITION 6.25 If 58 = { v u Vi . v„) is a kbasis fur V then a 

real quadratic form on V is a function Q V- R defined by 

ft ji 

Q\v) = E I ( 1 ) 

tm 1 /ml 11 * 

n 

wwre v = I x { v ( (jr f € R } and A - (a t -} is a real symmetric matrix. 

For example, lfv€ = ^ * J, then Q r V -* R is given by 
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QfP) - 2x t 2 + 3x 3 7 + XjXi+x 5 x, 

= 2jr |' + Jxa * + 2x, x 3 
The expression (1) will usually be written as 


Q{v) = Z */i*i* t 


<-i= 1 


and the coefficient a l} in thLS expression is Shared equally between the 
Utf)’ and (/„ j'Fpositoons of the matrix A. 

If X = ix^x it ... ..rji is the coordinate vector of v t then Q(v) can 
be expressed in matrix form as 

Q{y\ = XAX 1 


We now consider the effect of a change of R basis on this expression 
for 0. 

Let 58' - (wj, uj, - .. , v* a | be another Ft-basjs for V. then (see p.lQQj 

u 


v‘=xp tj mi= 


I, . - -, n), where P = {p s .) is an invertible matrix. 


\fv = 



then 


- £*(***) 

f<= i i i 

ft i n v 

■ 

and hence 

X 1 = PY' where Y = . .. ( ^„) 

Hence, 

Q(P) = XAX ' = YP'APY 1 = Y{P X AP) Y 1 

where F l AF is also a symmetric matrix since (f 1 ^/ 5 ) 1 -P'AP 
If D = diagU], , . - , \ n ) then Q : v R defined by 

G(»I - X,*, 3 + ... + \„*,’ 

is a real quadratic form on V which has a Simple form called a diagonal 
quadratic form. We consider whether it is possible Lo find a R-basis for 
I'so that a given real quadratic form can he represented as a Jiagnonal 


_ 
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qua lira Lie form. We shall be even mure restrictive With a view La liter 
geometrical applications; we shall insist that the matrix /* involved in 
the transformation is orthogonal. We now of course have precisely the 
same problem as was considered in the previous section and it follows 
immediately from Theorem 6 .24 that we have 

THEOREM 6,26 Any real quadratic form may be reduced to a 
diaganat quadratic form by m earn of an orthogonal transform tion. 

This result has a useful and elegant application in analytic geometry, 

The general equation of a conic section is of the form 

ax 2 + 2&x>- +cy 2 + ux + yy +p “ 0 (1) 

We caU 

ax 2 + 2 bxy + cy 1 

the quadratic form associated with (3), Equation (1 lean therefore he 
expressed in the matrix form 


3 C) + fc ')(*) + '"° 

Thus, if X -{xj^) p A = T r=(u,0, we have 


A 'AX* + TX t + p = 0 

The matrix A is symmetric and by the above theorem f there exists an 
orthogonal matrix P such thai 



where X, „ \ a are the eigenvalues of A, Thus, by carrying out the trans¬ 
formation^*) - (or ^ *,) = P r (* ) ) die form (1) reduces to 

X*P r APX** + TPX t{ f p = 0 

or 

Xjx' 3 + X a y 3 + ux + vy' + p' = 0 (2) 

where p' =p and (u f v N ) = TP, 

Thus, by introducing new axes, called the principal axes Ox and 0/ 
in the jrj'-plane in directions AT t and Xj . where P = (AT| ) die conic 
section has a graph represented by (2), Equation 2 may be reduced 
further, depending on the values of and A lr The following cases are 
considered. 
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Gist -1 Xj f 0, X* 1* 0 
If we put 

y-y+’L.y'.-y+al 

2X, 2Xj 

in ( 2 h we obtain 

W* + X 2 >'" 3 * p" 


where 


P = 


(-■ -W) 


If \| - Xj, then this is the equaiiun of a circle with centre 
( — . — ~ ) in the xV-planc and radius vV'Ai • If X| >0, X 3 > 0 

' 2Xj _Xj / 

r . ,i* h 

- — .-l 

2X] 2 A n/ 

in the jeV-p]ane which meets the new Ox' -axis at the points 

^ i \/p '' /X, , fl) and the new Qv-axis at the points |^Q, ±\/j p'TXj ) , 

If X, > 0, X 2 <0, it is the equation of a hyperbola with centre 

^ ) in the xy '-plane and the vertices are £ t \/p'7X 1 , o') 

and the two lines y'faip'fk 1 = - x'7vV Txj (or “ *\/X t x lr ji 

□re the asymptotes. 

Cue 2 X| - 0. X-j i G 
If we put 

rx I V 

y -y + — 

2X* 

in (2), we obtain 

Xjjr 1 ' 3 + ux + p' =0 

Further, putting x -x + p’fu „ if u ^0. this becomes 

X :J y >n + uV = 0 
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which is Eke equation of a patabola with vertex f - yV , — ) in the 

xV-plane and focus ( ujA\ 2 , 0). Hie case f 0, = 0 can be dealt 

with similarly. There are further “degenerate" cases which we shall not 
consider further here. 

The standard forni of these conics are given in Appendix I. 

This is illustrated ip the Following examples. Ike first examples are 
“central” conics. 


EXAMPLES 

I. Draw a graph of the conic section 
5x J -6*> 4- 5/ = 8 
In the matrix form this is 
5 -3 

\-3 5 

The eigenvalues are roots of 


i) o- 


S —Jt “-3 
-3 5 -x 


= (2-x) 


a 

: -3 

0 s—* 


= (2 -X)(%-X) 


i.e. the eigenvalues arc A - 2 t S and the corresponding eigenvectors are f 1 

t t\ u/ 

and j. Normaikmg these vectors, we have 


P - 

and then 


= ^(! -I) 


P X AP = 


2 0 
0 8 


Now rating new axes Chi', 0 \y* in (he directions ! ^=, and 

(^P V?) TeSpeCttVfily ' ( 0r (^' + > r ')n,V (*'“/)) 


the equation of the conic becomes 


176 


2jt f3 + 8/ 3 - g 

r2 

X ,2 

or — + y - 1 

4 

That is, we hive an ellipse with graph as in fig. 2, 



t- lipuie 2 


2. Draw a graph of the conic section 
7jt- \ 2xy-2y 1 = 3 
The corresponding matrix is 



which has eigenvalues 5 and 10 and eigenvectors! J and 

1 ).-» 


P l AP = 

\ 0 10 


respectively. Let 
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Taking, new axes Gx\ 0 v' in the directions J and ^^ .— J 

respectively, the equation of the conic becomes 
—5 x* 2 + IQv rl = 10 


or 


x a . 

1 


( This may also be obtained by puttingx — ~J= {x' — 2 y'} t 
l f s ^ 

y = ( 2 jc +y ),J Thus, we have a hyperbola as illustrated in Fig. 3 , 



Figure 3 


3 . Identify and sketch the graph of the conic section whose equation is 
X s + y 1 - 2 xy - 4 \/ 2 je t 6 = 0 
TtiC matrix form is 

<**'> (J '!)0 + (- W * fl >(3 + 6 =o 
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Hie characteristic polynomial of this matrix is x(x— 2 ) and the eigen¬ 


values are 0 and 2. Tire corresponding eigenvectors arc 



fespeC t ive |y. ! ( we n ow 3 c t 



[hen. taking new axes 0.x', Oh 1 ' in the directions (l A/2 ,1 A/2 I and 
1 1 S/2, - I A/2) respectively the equation of Lhe conic section becomes 


V 1 + 1 hj2{-A\/2 , 0 ) ( j _!)(*) + 6=0 

or 

yj _V_2jr J + l*0 

from which we obtain 

ty'-lf =2(x-l> 

Til us. the conic section is a parabola with vertex ( 1 , 1 ) in {*'< >-'Tptane, 

which ha.s cooriiiiiaf es 1 A /2 1 ^ j j jl “ (V 5 /Q) ' n 

the U, rVplane as illustrated in Figure 4 , 
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The same method can be used for quadric smrfacBs in J-space. The 
general equal] an of A quadric surface is of [he form 

tf.v* + by* + t'z 1 + 2Jxy + 2exz + 2 fyz + ux + vy + wz + p - 0 
which may be apin represented in the matrix form 
XAX 1 + TX* + p=fl 
where now 

( a d c \ 

d fr / ) . ^ ^ (w T v. w) 

* f *7 

This may be reduced in precisely the same way as the conic section - 
details are not given in this ease. Eh Appendix 2 h the graphs of the 
non-degenerate surfaces are given. The methods are ill us haled in ibe 
following examples. 


examples 

j, [dentify the quadric surface whose equation is 
7.x 1 + 7V 2 + | Or 5 — 2xy — 4xz + 4 yz = 24 


The eurresp unding matrix is 


A = 


/ 7 
-1 

'.-2 



which has been considered in Example 2 on p.J 6 S. 


The eigenvalues are \ = 6 , 12. Corresponding to X = 12 the eigenvector 
is ( & v^) ait ^ ct,rr espcmding toV -6 the urthogonal 

eigenvectors are (^' aritf ~m) Taldrig new axes 


Qx , Oy and Qz tn the direction of these unit vectors respectively (or 
equivalently by substituting 

1 = ^(-* , + W/+VSV) 

y - ^ (*' + y/Sy’~y/2i’l 
1 ~ Q*' +v^i'}) 
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the quadric surface takes, the form, 
[2*'" + 6y " + 6r" = 24 
or 



which is the equation of an ellipsnid- 

2 , Identify the quadric surface whose equation is 

2x 7 *y* - 3 : 1 +■ 1 2xv - 4 xz - iyz 1 fix + 1 ly + 22z + 44 - 0 
The corresponding matrix form is 

l 6 -z\ / *\ / X 






+ 44 =0 


1 1 may be verified that the eigenvalues of this matrix are -3. —6 and 9 
and lire corresponding eigenvectors are 



respectively. If we pul 

2 -1 


P= \ 



and Lake new axes lix", 0 > , 0 " an the direction of the unit vectors 
i( 2 ,-l, 2 j, K 1 , 2 , 2 }, 3 ( 2 ^ 2 . J) respectively, then the equation of 
the quadric surface becomes 

3 *' 2 + 6 v ?1 -\6x' -20y' 6i f -44=0 


^ I = (16,20.6) 


2 -1 

since )(&J2£3) | -1 2 

2 2 

Now, put x" = x r - 8/3 =y‘ 5(3, z" = z + lf3\ then the equation 

of the quadric surface becomes 

x Hi + 2/' 3 — 3 a" a = 27 


or 


Py-T ) 1 


V2 / 


- - — * 1 
a 32 


|S1 













Thus, we have a hyperboloid ot' one slice l {see Appendix 2) with centre 

/ 2 -I 2 

|/9(M ,-m -i 2 2 

\ 2 2 

with axes in the direction of Lite unit vectors given above, 

Exercise 6.6 

1- Reduce the following, real quadratic forms to diagonal form 

(i) x i +y i +xy 

(ii) x 1 + y 1 — xy 

(in) 3 jt 2 + 3.V 1 + 55 3 — 2xy 

(iv) 2pcy + 2xz 4- 2yz 

(v) 5 jt 3 + 11/ - 2z 3 + I 2xz + I lyz 

2. Find the principal axes, centre and sketch the trrapb of (he fbflowinp conics 

(i) xy — 2 

(ii) 3^-2/+ ! 2 *y = 42 

(iii) lx 1 + Ay* - 4xy = 24 

ftv) I3 x 2 + 13f 1 + ] Ojcj^ - 72. 

(v) Sx 1 + 2fsxy + Sy 1 - 70:v - 3flv “ 7 

(vi) 73* 1 + 72 jc>- + 52 y* - I90x 80y * -25 

3* Find the principal axes, centre and identify the quadric surface whose 


equatior 

I is 


0) 

2xy + 2jcz + 2 yz - 4 


(ii) 

x 3 4- ly 1 + i a — 2xy ~ lyz = 1 


(iii) 

4x* + 3/ + 3**-4xv + 4xi - 

6yz - 16 

(iv) 

5x 2 + ly 1 + 2z J + 4xy + 4xz +■ 

2^r = 7 

(v) 

x % + jy J + I 1 “ 4x>' - 4xz — 4_yz 

= 3 

(vi) 

1 lx’ + 1 Ay 1 + 4a 3 - I2xy + 3 2 xj = 22 , 

(™) 

7* 1 - 2> ,z +4z 3 + I6yz-20xz 

- 4xy + Sx + 5^ - 

{via) 

lx 1 - 2y 2 2z 2 Syr+ICbrz 

- IOxi- + lx + 2s - 


j - <W) 


1S2 


APPENDIX 1 


Conic Sections 
















APPENDIX 2 

Quadric Surfaces 




Elliptic paiabolotd 


jc 2 y 3 
— =z 

a 1 b 1 



Hyperboloid ol' one sheet 


~ ~ ^ — =| 

a 1 b x c* 


jr 2 / . 
a 3 



Hyperboloid of two sheets 


*! _ y _ i! _. 

fr 3 cr 3 




2 " c 2 


it 
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Solutions to Exercises 


Exercises 1.2 


MO 


On) 


Q 

0 


m 

/ 3 

0 

c\ 



1 

0 

- 1 /s 


0 

1 

a 



0 

1 

1/S / 


0 

0 

1 







\0 

0 

0 / 



0 

1/2 

1/2 \ 

(iv) 

/l 

0 

1 

0 

2 

1 

2 

1 

1 

f 0 

1 

1 

0 

0 

D 

0 

0 


0 

0 

0 

1 

2 

0 

0 

0 / 

0 

0 

0 

0 

0 





Vo 

0 

0 

0 

0 


(V) 


2. (i) 



a 

7 



E.xcrcisc 1.3 

I. Central solutions ate; 

(!) (-^—2jfi-3tr r 3 X 4^, 5X f 5 m- 5v) 

(ii> (-9X-7M, ]9X+35 m, 7X-49m, I4X, 14m) 

(iii) (X. -X r 4X3X) 

(iv) (3X—6 m. 7X-9M+2fr,3X h 3M^t f .^ v ) 
where X, m, v arc arbiffsry. 
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2- General solutions, are: 


(i) (4-2X-^9-tt-3^) 

(ii) No solution 

<iii) (-1-X+4 + 7/2+I/2X-5/2^-1/2-1/2\+1/2^X^) 

(iv) No solution 

where X,p are arbitrary , 

3. (a) (i) X^S; (ii) X = 8, /u#8: (iii) X“8,p- 8 

(b) (i) X# 11; (ii) X=ll,^#3: (Iii) X = 11 .m = 3 

4. 

when X = 1 , la - 3h + c = 0, (2d-j!?~^ b-a, p) 
when X = 2, 2a-3b+i' - 0 , (b—a—ti*tL > —b+ 2d), p arbitrary 

5. (j) X*=-14, (-H* 3-2^ vy,\* -14,(0, 1.1) 

(ii) X*1/2: X = -1,<-23g, 1, X * 1/2, X * -1, 

(-I4X’«XM2.8X’ -4A-6, 3-2X) ' 

(iii) X= I, (1/3,-2/3) 

(iv) X 2 +2X = a. (-5fj+2+p f Ja-j-p, p,p-l), p arbitrary 
(5. (-X- 2p T I-X, X. 1-2p, p), X, p arbitrary 

7. /i = S, X(1 -I A 1,-1 AI -1), X. arbitrary 

ft - 9, (GA0AOAOAO) 


/Txerdjes /.4 


3 P ji = 2, b = 1/4, c - -1/54 ora = —2, b = -1/4,c = 1/64 

5. If .4 = (a (/ ) then a t n-/ *, - a H . f+ u A /=!.n) 

Ererri'ses /,J 


4 + .4 fa)" 1 - .4(—ct); i 3 -3x 2 +3x 1 =0 


6, t -A 



V~2 \-l 1/ 
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Exercises 1,6 


1- (0 

f-J 2 1 \ 

(ii) / 11 -9 11 

li 

-1 0 1 

W -7 9 —2 


is -2 -l/ 

1 2 -3 1 


fv) 


fvii) 



(ib) 

5 

—2 

19 \ 

(iv) 

f 2 

3 

,i 

25 

5 

-10 

X 

E7 

13 

7f 

5 

13 

-» 

2 5 

l 9 

1 


-S, 


(vi) 


None 


ijfert r'jei Jf, 7 


E- CO 


(ii) 



(iii) 

/ 5 

3 

-1 

°\ 

P=t J_ 

4 

0 

4 

0 

11 

-7 

3 

—1 

0 


\ 1 

0 

0 

1 / 

(iv) 

/o 


2 


P = J_ 

0 

2 

6 

2> 

1J 

0 

3 

2 

^ , 

1 

11 

1 

0 

1/ 


q=/ 3 


C = rV 


/ 3.4 0 0 —4 -6 

0 14 0 2 —4 

0 14-11 
0 0 14 




0 
0 

[ 0 0 0 


0 


-1 

0 

14 


(P and Q are not uniquely determined,) 
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2. (©,(!«)) , ((«)) • !©),(*) 1 


Exercises 2.1 

I- CO 7 1 00 12. Cili> -IS, (iv) -6, (v) 0 

2, (i) (6 -c) (a+b+r) 

(ii) (a b ) (a—i) (6 —c ) (j+^+c ) (a* +fr* +c 1 ) 

(iii) - 2 (a -b ) (<J-c }(p -c ) {a +£> +f} (a z +b 2 +i J ) 

(iv) Sj (x y ) (x-2 ) iY-2 j (x J +y 3 -hi 2 -to 2 ) 

(v) (tfr-A) (tf-c) {b -e) (a '•A“he ) (a' +b 1 +r 5 ) 

3, 0 = tin— ff/| 2 or ntr + 7ir/l2 (n =0,1,2... ,} 

4, 0 ,b-i\(s+h+c)f2 

Exercises 2,2 

1, (0 5. (ii) IJ + (ill} 2 

2, a,b.c. - (a+h+c) 

3, fi) 0, 0i| ±4 

s. 

6. 2 3t 

Exercises 2-3 
L (i) i.s nuTi’siHguJar 

2, (a 0) 1 (a-7) 1 {?' 7) 1 {q-H3+7> 

3. !(^r(8£ 3 -27r) 

5, / a b c \ 

C= c ^ b) 

\ b C a f 

tea 


6. (i) Yes (ii) No 

7. (-5/3, —12/3. -16/3); p= 2, (10/3 + ^ 2/3 + #t>; J? “- 

^ arbitrary 


S. (i) fe = —I,Jfc =-4. (ii) it 


Exercises 2.4 


1 - (0 

'-3 

5 



i | 

■ 7 ^ 

IS 

-6 

18 



6 

14 

-iej 


(ii) 

f 3 

-I 

-2 


_ £ 

9 

3 

4 

1 




—3 

3 J 


(iii) 

Z 11 

-9 

L\ 



“ 7 

9 

-2 




-3 

>1 


2 (i) ( 1 , 0 . 0 ) 

(ii) 

ns 

4U7J69) 

3, 


/ 

1 

-r -r 

r - ±L, 


1 - 

-r 

1 t 


(1 

-r 2 ) 

-* 

*• w 


(iii) k - i 


5. 



-O+l) 


-I 

x J -x-l 

- 0 + 1 ) 


x +1 \ _ 

2(x+I) , x-41. 

(rtl) 3 j 2 


Exercises 3.3 
l. (i) and (v) 


2 . (ii), (its) arid fiv) 


3, it), (iii j and (iv) 

4, (I'Miii) and (vi) 


3, (5+jj, 4+p, ,u) 


5. (ii) and (iii) 
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Exercises 3.4 


2 . 11.2.1), (°4.-3) 

5, e.g. {tl 1 0,l,i),(l,0^.4).[i,0,0,0),(0,l,0fl)} 

7, e g. {(1.1,0,-1), <4.-2,!,,0).(1J0.0,0), (0,! ,0.0)} 

((; d ■ c;»• 

(C S)J. ((! S)■ (_? i).(; !)•(? !)| 

9. e.g, f(L,0-1,0), (0,1.1,0 Ml ,0-0,0 h (0,0.1 „-l}}, {(04 AO)} 

IG.e-g. {{2,1,0,0 U I J0 t l,0). (3,0.0,11) 

6 2. + 3u; 

B. (i) Yes (ill No (ill) Yes 

14. « -No. v Yes, e.g. {(2,-U,2) ( (^l T l,U) s (3.-1 A-I).UA0,O)J 

{(1,0.4-1)42. 1,3,2). (1,0.00), (D,l,QjO)J 

15. eg. f(]jD p -U),(2.-1.04)4144,2)} . 5u{y) 

16. 4.B;2.4 

17. ((0,1,1)) ; ((l t l,0)4a+U)} 

ift. fi* {I -f 3 +/ 3 .2+/--f ,+ /’. 


1. (S) Yes {ii) No (iii) No (iv) No 

1. (1) Yes (ii| Yes (iii) Yes |iv) No 

3, (i) Yes (nJ Yes (iii) No (iv) Yes (v) Yes 
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Exercises 4.2 



l. j 3 0 

0 -1 
1-2 0 


0\ 

-I | 


2 1 
0 I 


(ii) /s 11 12 \ 

\ 2 1 0 

l 2 4 "*/ 


■r 


S| 5 

*J2 


.matrices relative to { e x t , t? ljH tj], } are 


(i) 


*n 

0 

hi 

0 


(iii) 


/° 


-Jr a 

i 2 i 0 

\° **> 


0 

*12 

0 \ 

01) 

1 *i i 

*3 1 

0 

*11 

0 

*t J 


*13 

*33 

0 

0 

*33 

0 


0 

0 

*1 i 

*21 

0 

*2 3 j 


0 

0 

*11 


-Sj 1 

*1 

0 




u 

1 1 —*33 ) 

0 

*13 





( S 2J—*ll) *11 


“*1 1 


0 



6. / 3 

^+2 

1 1 

(i) AtM. fi¥= l, ij 

1+7+jU 

A+fi+X/i 


(ii) 

\ 1+A 1 +fi ; 

x a V+V 

u 2 l 


7. r* 1 ,/.! 1 

. xy r xz.yz} 




j a 1 0 0 0 0 Q\ 

1 P* 0 0 o 0- - \ 

I 7 s 0 7 0 0 

2a 0 M 0 M 

2 a 0 0 07 0 0 j 

\ I 2#y 0 (0+7) 0 0 / 
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8. {1, JCi y, x 2 ' xy.y 2 \ t {l.x t x 2 1 } 

fl 0200^1 

' o 1 0 0 2 0 1 

0 0 0 0 0 0 

0 o o I 0 0 

\ 0 0 o o o o 

\ 0 0 0 0 0 0 / 


txercise$ 4.3 

l.e*. {{ L2,3,0) N (lflA 0) , U UAM 


2 . 2.2 

3. 


I1'F = 


1 I 1 

i I I 

0 1 1 

0 0 1 


! 

I 

I 

1 


\ 


0 0 0 


I t 

0 I 


2 


t -i i -i 
0 1-23 

0 0 I -3 

0 0 0 1 


{-If 

i 

i-ifCl) 
(-l n+1 (")) 



I 
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fa) <i) 




A = 


0 1 0 
0 0 2 
0 0 0 




0 0 0 
0 0 0 


00 Q"AQ 
(b ) CL) 

B = 


(iil) FUF 


I 1 t 
0 I 1 
0 0 1 
0 0 0 


ooo 


<ii) Q 'BQ <iii> r l BP 

4. 2,2; X -y = 0 

5. ker£ = {«|a€:!R]l „ im S = 


0 0 
0 o 


On 
0 Q ' 


(?) 


Z a t ,x { yi\f*t } £R 

i h j c 0 


ker T - {a-tflx+Try +bxy € R) 

ins T=j X x*y f Ictjy 6 R. 0(i i =0 

\ i. f*Q 


...x*.* 1 l y,.,,, xy n - l t y n } 
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diagk4 0 „4 E . A„ ) where A t - diag jf. l,-. ■ , d (f ~ Q, J t . . ^n) 

(f+1) copies 

diag W 0 Mi ..,, , B n j where B { - diag (i* -f(2Jt+l i+2flr )MU.., . , n; 

...j 

6. fi) R fia) {/(*)!/<■> fc) = 0) n >J <iil) <&*> 


7. (i) (0) .iWj{R). fil) (0},A7 3 (R), (Li) 0 a.b 6 R), 


(U 3 


a.be R 


S. p-q = n-m 
9. I 

I i. V = V % (RJ, rfo.fr)-(0, a), tf.fr e K. No 


£jre/rrsi'i 4.4 1 

1, k# 1/8 

2. 1/3 (rtj+ft 2 +a 3 . ^a,+5Qj+2a 3 ) 

4. kerD=£ 0 


£jrenrii&y 4.3 

2, (iJ a ^ E t -14 rank 4; a = 1 rank 2\ tf = —14 rank 3 

iti > a ^O. 1, 21 /2D rank 4; a - 0 rank 2i a — 1 rank 3- a - 21/20 rank 3 

3, 2,2 

4. t = 0, —h / = 0 rank 2: r = -1 rank 2 

5. rank 3 unless 0 = 7=0 when rank ( or a=0. £= 7^0 when rank 2 
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Exercise* 5. i 


1. (Li) and IiiLJ 

2. (Q,2 t 1) 

3. Ci) fu)/38 {iii> \/2 

4. (i) cos' 1 6V4-i (ii) */2 
Exercises 5.2 

J. (i>) 

2. (i) 

3. (1 ) T (ii) and till) 

4. None 

5. (ij 3.3.-/!?, -2. cm * 1 -2/9 

(ii) /TT,/46./T05-2S,CQa' , 2S//782 

(iii) !A/3- l//2,/|5w a 4)/6 tt 2 , 2/ir .cus" 1 — 

If 

6. Sum ul‘ squares of diagonals equals sunn of squares of sides 

Exercises 5.3 

2. fi) <fl,] ,0,0), (2,0,1 £},( 

(ill <(!+/. 1 —r j£> 

3. I -6x+Ex 2 . 1//2 ,<>ac + 2nd + ibc +2bd* 0 

4. /2 sin rrrjr, fi = 1 ,2, ... , n ) 

5. fi) f«l -1,1). (4.5,1), (2 -1 ,-3ii 

m Id, M.iM(u,G t iM3j-i.-m 

(iii) ((1,-1, 0 * (1+41.2- r T 5+i)f 
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6. (I) {{J /s/2,0J h/2 ) n (0.1,0), (1 /s/2,01 /y/2 ) ) 

0i3 {I ni 1 1 i ,L H 1 /2{U ,iM I ! JO -1.0), 1 /V2(D T 1 .0,1) j 

8. {l,2jr-Ldv z -&r+!,2at s -J0¥ J + a2jf-i} 

9 0) ;(U,-0 

(ij I {1.1 A/3( 2x - 1), 1 VSlSx 3 &t+1 )} ; 14/3 V3/2.V?/6 . (5/6,d T v5/6) 

10. {I,*,* 2 1/5,x 3 3/7* ) 

c 

12. They are perpendicular 

Extremes (5.2 

L (i) (a) None (b) None (e) 1 ±yfli 

(u) (fl) -1 [b> -1 (c) -J.±i 

(iii) (a) 1 (b) \ t ±y/2 (c) U±sfi,±i 

2. (i) < x>; 1, < (l*-i,Q»;2, < (2,-1,—21 >; 

3, < (I,-l,-2)> 

m <i -*} 3 ;!,<(! t U» 

{iii) -xtx 3 -2*-7); 0,(1,2+/-I).-1 

<iv) -fl-xf (l+x)(3-jr):l f <(1,0,0,- I),(0,1 ,-!£)>; 

-i*<0i i 1 -ia)> 1 3 t <(u.un> 

(v) (x-1 ) J U-2)U-3);l .<n -K0.0) 1 (l,0,“l 1 0)> 

2,<1 -2/l,l l 2)>,3,<(0 1 3,U)> 

fvi) (k— 1) (x a '“2){af a +1); I, <(JLQ t l, l t OJ>;VT t <{-l 1 vTj,0,0^ 

-V?.<( 1 V2,-1,0,0)>;i.<( 1,0,0, I +i, 1-/)[>; —f. <{1.0,0-1 -t\ 

l+0> 

4, For i= (,2,_.nJfZj. is an eigenvector corresponding to \ ( then 37 is 

an eigenvector corresponding to |i) 1/Xy and (ii) X* (A = I J. , -I 

5, 0 ( <(l,0 1 ,0)> 


\9b 


7. Reflection: l, < (cos sitl £)>; -I.< (sin ^ costf)> 
Rotation: None 

fi. (i) (—J Y 1 +a a .r+...+o rt x"" 1 x") 

(ti) (b-x ) n - 1 T +a« 1 +6-*i 


Excises 6.3 
I (i) / 


0 1+/ \-i 

e i i 


Hi) 


F = 


-1 

-i 


1 


1 


(iii) 


F= U 


2 J 
-1 

-2 -2 

4 2 

0 -I 


(iv) 


P = 


-1 

0 

1 


t P' x AP = ding t I,! 1 , 4} 


,P'AP*ti isg {1,2,3} 


.p-'AF^tlw (0,1,2 ) 


1 P 1 AP= dias(2,I+/ 1 2-2i) 


\ 1 0 -I 

tv) Not diagonal Stable 


(vi) 


F = 


1 

-i 


I 


\-l 


I 2 

! 2 

1 -1 / 


,P''/iF = dijg (0.1,2,-1 ] 


(vii) Not dragonalizablc 

2, A 1, < (3,5) >; 3, < (1,1 )>;F = 
8 . 2,<(i -l)> 


0 


3. 


P= 


a Q 

a 

-1 — 1 

-1 0 


fl' 

a 

-a 

I 


. /*" 1 AP = diag (fl.fl,-fl h 3 +b +<j' ) 
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4, 


( 2 2"H_ 2 3*1*1 | 

0 2 H+I 

0 0 23" 


5. 

(2 1 

-A 

/ i o 

o\ 

/ 

5 

-a 

6\ 

P- 

1 0 

11 

it 

o 

0 \P~' = 

l 

i 

I 




U o 

0 

l- 3 

6 

4 I 


Exercises 6.4 

1. Cl) * (*-2)l fit) ix-U 1 (x-2) t {iii) ix-13 (x -2); Civ) (x-if 

2. x* (xy-m A (x) = x rf -at i , x*~ ] -a n 2 x ri J . * * n t x-a 0 

3. fr-l}(*+2)U 3.U* l)(s+2f fJc-3).(*-l f (x+2)ix-3), 

(x-\ f (x+2)* {X -3L (jf-1 P U +2){x-3 |, ue- U 3 (* +2 f U-3 J 

5, 0) 4 (iii) diagonal izabk 


Exercises 6.5 


i. (i) 

/ 2 2 

-l\ 

(ft) 

3 2 

6 \ 



i/3 

2 -1 

2 

Ip 

-6 3 

- 1 




W 2 

2 ! 


^ —2 —6 

3 J 



(iii) 

flh/2 

2/75 

l/s/6 

\ 

(iv) 

1 1 3 

2y/2 


i/»A 

0 

-1 b/6 


i Vi a 

] 3 

2\f2 


\ 0 

1/75 

-2 bJt 

,/ 


[4 0 

V2 


Exercises 6.6 


L(i) 3/2 x 2 +I/2V 1 ! 
(jv) 2ar 2 - v 1 i J ; 

(11) $/2x 2 + t/2;’ 3 ; flil> 2x 2 + 4v ? + St 2 ; 
(v) 7,x 3 7y 3 + I4z 3 


l^S 


2. (!) 1/72(1,l>,lV2(l,-l);a*+j,»=4; 

<ii) 1/7T3 (34UA/T3 a.-3}ix*l6 -y*p = 1: 

(iii) I /75(1,2j, l/s/S (2.-1 );**/8 +y J /3 - !; 

(v) 1/72<U),I/V$ (l.-l);(l/2.^S/2)i**A»-J' , /» = l: 

(vi) 1/S (3,4). l/SM_3):(7/S.-)/5);;r ! /4 +j- ! “ 1 

3. li) 1/77(1,1,1), 1/72(1.-10), 1/76(1,1, 2);2 **-ji 3 -i 1 11 

(ii) 1 / 73 ( 1 , 1 . 1 ), l/i/I(I.O.-I). 1 /VS(l,- 2 ,l);j>* + 3 s 1 = 1 

(iii) 1/75(2,1,1), 1.73(1. 1,1). 1A/2 <0.1,1 fc* l ffl+ r ‘/2*l 

(iv) IA/3 (0.1 .-I). 1/73 (1,-1-1), l/v'f (2.1.!):* 3 /7 + y 1 /7 +7 

(*) lWSdt-1,0), 1^(1,1,-2),l/v5{U.l);^ +/ -7 = 1 

(vi) 1/11 (7.6,61.1/11 (6,-9,2). 1/11 2 j 3 *y a = J 

(vii) 1/3(1 ,-24), t/3 (—2,1,2), 1/3(2,24);2z=6v J 37 

(vili) 1/73(1,1,-1), I//2 (0,1,1), 1,76(2.-1.1 );< 1/12, 1/S.1/24) 
x 1 +2v 2 37 = 1/72 
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Addition: 

of linear transformation, 115 
of matrices, 16 
of vectors, 66, 67 
Adjoint matrix. 59 
Annie between vectors, E35 
Associative law of 
addition, 20 
mul liplicu L Ion, 20 
Augmented matrix, 9 
Axes-, pritidpal, £74 

Baris (A >. 76 -aa 
change of, 99-104 
cnordinates relative to, 31 
orthogonal, 13-7 
odhommul, 137 
standard, 79 

C[tf, P], 72 
( an nn lcj! form, 34 
Cauchy-Sdiwarst ip.oqiiiiality , 114 
Cay ley'Harntlmn Theorem. 163 
Chuvgfe of A-basis, 99 -104 
Chara clerkstic pd y noniiat: 

of a linear transformation, I S3 
of a matrix, 15 Q 
Co factor, 44 
Column; 

equivalent matrices. 33 
of u matrix, 3 
tank, 118, ]46 
Commutative law: 
of addition, 30 
of multiplication. 19 
Complement (orthogonal), 145 
Conic Section. 174 • l 79 
Consistent solution. 9 
Coordinates, R3 
Cramer-solution, 61 

Determinant; 

2 s 2,3 x 3. 38-42 
tumpu tat Ion of, 48-50 
definition of, 43 


existence of, 45 -46 
function, 43 
of a matrix, 43 
of a product, 5j 
of elementary matrices, 53 
of linear independent vectors, 77 
of the transpose:. 55 
row and column expansion, 4ft 
uniqueness of, 46-47 
Vandermonde, 50 
Diagonal matrix, 22 
Hi3.eonab7.able: 

linear transformation. 156 
matrix, 156 
DuganiiJiiatfcm: 

of a matrix, 156 160 
of a real symmetric matrix, 
164-169 
Dimension, S3 
Direct sum, £44 
Directed line segment, 63 
Direction cosines, 1 1 ft 
Distance between vectors.. 128, 134 
Distributive law, 211 
Dot product, 129 

Echelon matrix, 4 
reduced. 4 
l. b'C n v;i | uc. 149 

of 3 real symmetric rriillris, 

167-1 S| 

Eigenvector, 149 
Eiaottspflcc, 3 53 
Elementary: 

Column operations, 33 35 
matrix, 26 - 33 
row operations, 3-8 
Equality of matrices, iti 
Equations, linear fset: System of line-nt 
equations) 

Equivalence relations, 36. 147.158 
Equivalent matrices, 36 
column, 33 
row, 4,121-122 
systems, 9 
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Eudldcan space r I 31 

Field: 

of complex numbers C, 63 
of rational numbersQ,63 
of real numbers R, 63 
Finite: dimensional vecTur space, 83 
Finitely generated Space, 75 
F orm; 

canonical, 36 
dtagtinal quadratic, 173 
Jordan canonical, 159 
normal, 36 
real quadratic, 172 

Gauss elimifurkw method, 5 
Generated, 75 

G/aJH-5cJl LULd t Or lit oeonoi Edition 
Procedure. 139 

Homogeneoussystem of linear 

equations (iec System nl linear 
eq ujlionsi 

J lumomorph ism l'A-1. 91 
Identity: 

linear tTan-dcirmatifin. 94 
matrix,. 22 

Imaee of a linear irixnirarmation. Ifl6 
Inequality: 

L'aud]y-Schwarz, 134 
triangle, 134 
Inner product, 129,133 
space. ]3 3 ^ 
standard. 132 
Inverse 

of a matrix, 23. 30-32, 58-61 
ol an elementary row operation, 27 
Invertible 

linear transformation, 3 1 1 
matrix, 22, 30-32, 1M. 121 
Isomorphism (K-}, 13 0 

Jordan canrmtcaJ form, 156 

£-basts. 76 88 

standard Tor V^iK}, 79 
^-homomorphism, 91 
AT-teomorphic, 114 
^-isomorpliism, 1! 1 
A'-linear combi nation, 75 
A'^paoc, 67 

Kerne] of a linear transformation, 106 


Length Of a vector, I 27, I 32 

Linear: 

com birui km, 75 
dependent, 76 

equations {see System of linear 
equations) 

Independent, 76. 100 

A LEV f.T .1, I I 7 

Linear tmtafonruHon: 

characteristic polynomial of, 153 

definition of, 91 

eigenvalue of, 149 

eigenvector of. 349 

examples of, 92-94 

image of, 106 

invertible, I 3 £ 

kernel of, 11>6 

matrix of, 96 -99 

minimal polynomial of, 162 

tiyn^singulat, 1 I 1 

nullity of, M>6 

rank of, 106 

Matrices 1 

addition of, 16 
column equivalent, 33 
elementary, 26 33 
elementary operations on, 3- K, 
33-35 

equality of, 16 

eq u tva be n 1, 3fi 

mult [plication ot. 18 

row equivalent,4, 123 122 

scalar rtt ixltiplica! ion of, 3 

similarity of. 102. 147. 1 52. 3 62 

Matrix - 
adjoint, 59 
augmented, 9 

characteristic polynomial of, 150 

reicl'licicru. 9 

column rank of, 111, 146 

columns of a, 3 

definition of a, 3 

determinant of a. 43 

diagonal, 22 

echelon, 4 

eigenvalue of. 149 

eigenvector of, 149 

element of, 3 

elementary. 26 

identity, 22 

inverse of. 23. 30 32,58 -61 
invertible. 22. 30 32,100,121 
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minimal polyrtomai of, 16E 
non-lingular, 23,54 
of i linear transformation, 96-99 
orthogonal, 25 

rank of a, 11S—135,144 146 
reduced echelon, 4 
row rank of a, 146 

TOWS ij] 11, 3 

singular, 23 
skew-symmetric, 25 
symmetric, 25 
transpose of a, 33 
icn. I & 

Minimal polynomial; 

nf a linta r tra nxr'orma tion, ] 62 
of a matrix, I&] 

Minor, 44 

Pi<tn-*ing.ular matrix, 23, 54 

N orm o I' j vector ,132 

Normal form, 36 

Normalised vector, 132 

Nullity of a linear transform;]lion. 106 

Operations; 

elementary column, 33 35 
elementary row, 3-6 
Orth ugofiid; 

cumpbrnenl, 145 
matrix, 25 
set, 3 37 

vectors, 129, 135,137-142 
Orthogonally similar, 167 
Or Ui onormal set, 137 

PiK^P^K), 68 
F"ar-iiIIelogram rule, 64 
Perpendicular vectors, 129, 135 
Polynomial: 

characteristic, 150, 153 
minimal, 161 162 

Principal-axjiw ihenrcm, 174 
Product, inner {dot}, J29 

Quadra tie forms, \ 72 -I ft 2 
diagonal, 1 73 
matrix of, 173 
Qmuiric surface, I SO EfE2 

Hunk: 

column. I IS 

of 4 linear Iranxl arms Lion, H>6 
of a matrix, I IS ~] 25, 144-146 
row, 121 

Reduced echelon matrix,4 


Reflection, 92 
m itrlx of a ^ 98 
Rotation, 92 
matrix oF s, 99 
Row: 

equivalence. 4 

eq uka Lent malrtces, 4, 121-122 
operators {elementary}, 3 
rank of a matrix. (2l, 146 
Rows of a milt Lx, 3 

Scalar multiplication. 3 7, 66, 6ft 
Similarity nf matrices, 62, 147, 152, 
162 

Singular matrix, 23 
Skew-symmetric matrix, 25 
Solution: 

oi a system at' linear equations, 9 
space,. 72, 73 
trivial, 9 
Space: 

Euclidean, 121 
unitary. 131 

vector (set Vector ipacsi 
Standard: 

inner product, 132 
A'-basis, 79 
Subspaces, 7 3 75 
direct Stint of, 144 
finitely cc nenileJ, 75 
generated by a set, 75 
intersection of, 73, 87 -8H 
prop&F, 71 
bum of, 74, 87 -88 
union of, 73 
Sum: 

of linear transformations, 115 
of matrices. I 6 
of subspa ees, 74 
Symmetric matrix, 25 
real, 167-171 

System of linear equations. | -2, 
9-16,122 125 
augmented matrix of. 9 
consistent, 9 

Cramer-aalutiori of h 60 61 
equivalent, 9 
homogeneous, 9, 30-, 55 
matrix of cocflldentsof, 9 
solution of, 9 
solution space of, 72, 73 
trivial solution of, 9 

TtudbrnlAlkis: 

identity, 94 
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linear, 91 
t era, 94 

Transpose of a matt Lx. 23. 55 

Triangle inequality, I 34 

Unit vector. 127, 132 
U nllary space. E 3 E 

Vandermonde determinant, 50 
Vector space, 
definition of, 67 
dimension of, 83 
elementary pro pc rt ba. o 1.69 - 7 0 
examples of. 68-69 
finite dimensional, 83 
finitely generated, 75 
JiT-basts of a, 77 


Vectors: 

addition of, 64,66 
angle hex ween, 1 35 
direction cosines of, I 28 
distance between, 128, 134 
length of, 127, 132 
norm of. 3 31 

orthogonal i perpendicular), 129, 
135,137 142 
unit 127, 132 
feto, 67 

y„m. 66 

Zero: 

element H 67 
matrix, 16 
vector, &7 
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Linear Algebra 
An introduction 

Sqcond edition 

A.O, Morris 

This book is intended as a first and elementary introduction to linear 
algebra and mains Iheory for first and second year undergraduate 
students. II is based on a first course given a! The University College of 
Wales, Aberystwyth over a number of years. The approach emphasises 
the computational and practical aspects of the subject, but at the same 
time aims to give a thorough and rigorous introduction to the subject at a 
level suitable for use in the -introduction of abstract concepts in mathe¬ 
matics. The book is structured to give the more concrete and practical 
aspects first, leading naturally to the more abstract ideas developed later. 
The main emphasis of the first two chapters is to provide efficient and 
effective techniques for solving linear equations, expanding determinants, 
manipulating matrices, etc. The later chapters are more abstract in char¬ 
acter, but student motivation is maintained by considering the relevant 
geometrical i;oncepi in ? or 3 dimensions The aim is to show that the 
definitions of these abstract concepts are the natural and useful oKten 
s in ns of what occurs in lower dimension. In this second edition more 
examples of an analytical nature have been included. The final section on 
applications to analytical geometry has been extended and some sections 
have been altered to improve their clarity. Numerous exercises are in 
eluded in each section, with answers at the end of the book. 

Professor Morris obtained his B Sc. and Ph.D. degrees from the University 
College of North Wales.. Bangor, He then l.iecame Assistant Lecturer at the 
University College of Wales, Aberystwyth, where he is now -ProfessO' and 
Head of Department of Pure Mathematics He was Visiting Assistant 
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combinatorics. 
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